-- Logs begin at Wed 2022-09-07 13:54:57 UTC, end at Wed 2022-09-07 15:03:58 UTC. -- Sep 07 14:26:46.056108 dv-cinder-801354-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 14:26:46.064179 dv-cinder-801354-8-smb devstack@keystone.service[81751]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 14:26:46.066945 dv-cinder-801354-8-smb devstack@keystone.service[81751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 14:26:46 2022] *** Sep 07 14:26:46.067078 dv-cinder-801354-8-smb devstack@keystone.service[81751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 14:26:46.067192 dv-cinder-801354-8-smb devstack@keystone.service[81751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 14:26:46.067306 dv-cinder-801354-8-smb devstack@keystone.service[81751]: nodename: dv-cinder-801354-8-smb Sep 07 14:26:46.067430 dv-cinder-801354-8-smb devstack@keystone.service[81751]: machine: x86_64 Sep 07 14:26:46.067543 dv-cinder-801354-8-smb devstack@keystone.service[81751]: clock source: unix Sep 07 14:26:46.067646 dv-cinder-801354-8-smb devstack@keystone.service[81751]: pcre jit disabled Sep 07 14:26:46.067741 dv-cinder-801354-8-smb devstack@keystone.service[81751]: detected number of CPU cores: 4 Sep 07 14:26:46.067847 dv-cinder-801354-8-smb devstack@keystone.service[81751]: current working directory: / Sep 07 14:26:46.067949 dv-cinder-801354-8-smb devstack@keystone.service[81751]: detected binary path: /usr/bin/uwsgi-core Sep 07 14:26:46.068057 dv-cinder-801354-8-smb devstack@keystone.service[81751]: your processes number limit is 47680 Sep 07 14:26:46.068165 dv-cinder-801354-8-smb devstack@keystone.service[81751]: your memory page size is 4096 bytes Sep 07 14:26:46.068269 dv-cinder-801354-8-smb devstack@keystone.service[81751]: detected max file descriptor number: 2048 Sep 07 14:26:46.068376 dv-cinder-801354-8-smb devstack@keystone.service[81751]: lock engine: pthread robust mutexes Sep 07 14:26:46.068646 dv-cinder-801354-8-smb devstack@keystone.service[81751]: thunder lock: enabled Sep 07 14:26:46.068827 dv-cinder-801354-8-smb devstack@keystone.service[81751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 14:26:46.068912 dv-cinder-801354-8-smb devstack@keystone.service[81751]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 14:26:46.108305 dv-cinder-801354-8-smb devstack@keystone.service[81751]: Python main interpreter initialized at 0x55d9311ad9c0 Sep 07 14:26:46.108305 dv-cinder-801354-8-smb devstack@keystone.service[81751]: python threads support enabled Sep 07 14:26:46.108305 dv-cinder-801354-8-smb devstack@keystone.service[81751]: your server socket listen backlog is limited to 100 connections Sep 07 14:26:46.108305 dv-cinder-801354-8-smb devstack@keystone.service[81751]: your mercy for graceful operations on workers is 90 seconds Sep 07 14:26:46.108668 dv-cinder-801354-8-smb devstack@keystone.service[81751]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 14:26:46.108754 dv-cinder-801354-8-smb devstack@keystone.service[81751]: *** Operational MODE: preforking *** Sep 07 14:26:46.108981 dv-cinder-801354-8-smb devstack@keystone.service[81751]: *** uWSGI is running in multiple interpreter mode *** Sep 07 14:26:46.108981 dv-cinder-801354-8-smb devstack@keystone.service[81751]: spawned uWSGI master process (pid: 81751) Sep 07 14:26:46.109184 dv-cinder-801354-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 14:26:46.111449 dv-cinder-801354-8-smb devstack@keystone.service[81751]: spawned uWSGI worker 1 (pid: 81762, cores: 1) Sep 07 14:26:46.111449 dv-cinder-801354-8-smb devstack@keystone.service[81751]: spawned uWSGI worker 2 (pid: 81763, cores: 1) Sep 07 14:26:46.111449 dv-cinder-801354-8-smb devstack@keystone.service[81751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 14:26:50.555553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:26:50.555553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: from cryptography.utils import int_from_bytes Sep 07 14:26:50.556370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:26:50.556370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: from cryptography.utils import int_from_bytes Sep 07 14:26:50.556800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:26:50.556800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: from cryptography.utils import int_from_bytes Sep 07 14:26:50.556914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:26:50.556914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: from cryptography.utils import int_from_bytes Sep 07 14:26:50.607147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 14:26:50.607352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 14:26:50.607550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] command line args: [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 14:26:50.607704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 14:26:50.607825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 14:26:50.607916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 14:26:50.607999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ================================================================================ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 14:26:50.608079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] command line args: [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 14:26:50.608252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] admin_token = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.608340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 14:26:50.608501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config_dir = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.608581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ================================================================================ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 14:26:50.608690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.608777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] admin_token = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.608862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] config_source = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config_dir = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] debug = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] config_source = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] debug = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.609973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_config_append = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.610852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_dir = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_config_append = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_dir = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.611995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.612935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.613874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.614762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] publish_errors = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] publish_errors = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.615946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] standard_threads = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.616894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.617053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] standard_threads = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.617131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.617830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.617931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_journal = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_json = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_stderr = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] use_syslog = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_journal = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_json = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.618940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.619038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_stderr = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.619175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.619269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] use_syslog = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.619438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.619561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:26:50.619708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.619792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.619954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.620951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.621933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.622991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.623927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.624999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.625981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.626932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.627966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.628880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629813 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.629968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.630900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.631951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632113 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.632925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.633959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.634837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.635015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.635109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.635173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.635303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.635421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.635570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.641982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.642963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.643984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.644969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.645935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646385 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.646973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.external = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.external = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.647906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.password = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] auth.token = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.password = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.648960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] auth.token = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.649932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.650976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.651928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.652935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.653998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.654972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.655975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.656953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.657913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.658873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.659922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.660871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.661969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.662953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.663931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.664012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.664690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.664775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.664939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.665877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.666955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.667833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.668922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.669980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670229 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.670930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.671935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.672882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.673871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.674974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675552 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.675789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.681941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.682988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.683993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.684976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.685939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.686939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.687981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.688973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.689955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.690876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691639 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.691881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.692881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.693881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.694965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.695086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.695198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.695613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.695743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.695822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.695930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.696933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.697762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 14:26:50.697844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.698057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:26:50.698231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 14:26:50.730343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.730573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.730664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.730806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.730895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.731089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.739266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.739617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.768895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.769141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.769369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.769605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.838788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.842251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.888555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.888799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.899280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:50.899566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.054089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.054320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.054477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.054569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.055281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.055445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.055518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.055716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.055799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.056036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.056264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.056637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.079719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.079875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.079960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.080948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.081022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.081166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.097375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.097658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.110419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.110658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.110888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81762) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.111985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.112214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.112434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81763) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 14:26:51.135001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.135199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.135292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 14:26:51.135440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 14:26:51.135574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.135777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 14:26:51.135874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.135987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 14:26:51.136070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.136267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.136422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.136534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.136631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.136784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.136866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.137071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.146404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.146689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.146832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.146967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.147121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.147255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.147426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.147722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.154516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.154852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.157446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.157738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.157838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.158028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.158953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.159146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.159237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.159450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.159535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.159731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.159823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.160011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.160105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.160285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.160367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.160559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.185250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.186719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.187008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.191698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.191989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.192275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.195600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.198099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.198577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.198660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.198910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.204859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.207451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.207544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.207832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.213402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.213781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.223222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.223555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.223855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.224154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.224447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.224788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.225101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.225305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.225434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.227925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.231821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.234992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.235298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.239452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.243101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.245868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.246159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.247349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.247349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.247349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.247349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.247687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.247687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.250120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.253440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.253708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.257984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.261134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.263577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.263873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.264144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.264410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.264497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.264752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.265048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.265385 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.265640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.265939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.271216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.272790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.274443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.274722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.277435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.277726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.278014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.278299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.278702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.281810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.282133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.282409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.282676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.290123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.290350 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.290640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.290926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.291211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.291624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.291709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.291923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.292208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.293230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.293516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.296211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.296506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.296795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.297093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.297493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.308172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.309270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.309563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.309852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.310143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.310530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.310819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.311077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.311161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.313994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.315472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.316947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.317235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.317640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.324562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.326023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.327461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.328957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.329357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.329650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.329930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.330388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.333376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.334826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.336723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.337012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.337414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.338034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.338342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.338628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.343808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.345290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.345509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81762) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.345803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.346095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.350987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.351512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81762) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.357772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.358063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.358357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.365260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81763) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 14:26:51.365551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.365837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.366122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.366404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.366685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.366974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.367520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.367712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.368009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.368296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.368566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.368848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.369127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81763) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 14:26:51.384297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9311ad9c0 pid: 81762 (default app) Sep 07 14:26:51.387684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5dd8-1ac8-4306-914a-f61dbe6fb435 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:26:51.387977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5dd8-1ac8-4306-914a-f61dbe6fb435 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:26:51.388255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5dd8-1ac8-4306-914a-f61dbe6fb435 None None] PATH_INFO: `/v3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:26:51.392443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Sep 7 14:26:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:26:51.404222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9311ad9c0 pid: 81763 (default app) Sep 07 14:26:59.177404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:26:59.177928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:26:59.178021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:26:59.179277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:26:59.186874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:26:59.187290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:26:59.187454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:26:59.258544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: INFO dbcounter [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] Registered counter for database keystone Sep 07 14:26:59.278006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG oslo_db.sqlalchemy.engines [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:26:59.284427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writer thread running {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:26:59.466121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG passlib.handlers.bcrypt [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81763) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 14:26:59.466424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG passlib.handlers.bcrypt [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81763) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 14:26:59.524438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:26:59.526022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:26:59.655072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1/3] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:26:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 14:27:00.121151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:00.192995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: INFO dbcounter [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] Registered counter for database keystone Sep 07 14:27:00.214490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG oslo_db.sqlalchemy.engines [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:27:00.220773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writer thread running {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:27:00.342498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c38b5c-5370-45bc-a127-4e1936c3b332 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:00.346750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:00.347436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:00.347732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:00.348011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:00.357251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:00.408345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 14:27:00.408697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37970f7-0a04-4ec7-b4d8-9d43f8f60e9e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:00.418790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Sep 7 14:27:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 14:27:00.424768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:00.440106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb212ab-ed74-4a31-8a56-3ee123edf703 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:00.444593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:00.446127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:00.446412 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:00.446689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] PATH_INFO: `/v3/projects/c72aa1856259455ba01399dfc01a267f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:00.448176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c72aa1856259455ba01399dfc01a267f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:00.501003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 14:27:00.501352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240b707-0e0d-4a5e-b8ed-bf68da8519f6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:00.505977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 2/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Sep 7 14:27:00 2022] GET /identity/v3/projects/c72aa1856259455ba01399dfc01a267f => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:02.641072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf369-443c-4901-add5-25ecae098aa4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:02.641658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf369-443c-4901-add5-25ecae098aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:02.641658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdf369-443c-4901-add5-25ecae098aa4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:02.645820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 4/6] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:02.652016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:02.652477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:02.652570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:02.673396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:02.678840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:02.683705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 3/7] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 14:27:02.957926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf369-443c-4901-add5-25ecae098aa4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:02.970577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdf369-443c-4901-add5-25ecae098aa4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:02.974702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0ebc7-3498-462e-9535-f2ff02aa535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:02.975301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ebc7-3498-462e-9535-f2ff02aa535d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:02.975612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ebc7-3498-462e-9535-f2ff02aa535d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:02.975891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0ebc7-3498-462e-9535-f2ff02aa535d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:02.983888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0ebc7-3498-462e-9535-f2ff02aa535d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:02.985654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0ebc7-3498-462e-9535-f2ff02aa535d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:02.994961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Sep 7 14:27:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:27:03.000581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:03.010295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d58f0-a7ba-481c-af3f-5c805a16d064 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:03.014708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313bd0-74d8-4121-841d-f8d0aa41fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:03.015338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313bd0-74d8-4121-841d-f8d0aa41fc48 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:03.015656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313bd0-74d8-4121-841d-f8d0aa41fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:03.015936 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313bd0-74d8-4121-841d-f8d0aa41fc48 admin admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:03.017253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313bd0-74d8-4121-841d-f8d0aa41fc48 admin admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:03.019091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313bd0-74d8-4121-841d-f8d0aa41fc48 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:03.020640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 4/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Sep 7 14:27:02 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:05.347777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d555fb-873b-4cbd-9f50-5c476a366667 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:05.348293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d555fb-873b-4cbd-9f50-5c476a366667 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:05.348397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d555fb-873b-4cbd-9f50-5c476a366667 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:05.349638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:05.355364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adde2-472f-47ec-b210-57ef001204f2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:05.355800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adde2-472f-47ec-b210-57ef001204f2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:05.356079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01adde2-472f-47ec-b210-57ef001204f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:05.375189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d01adde2-472f-47ec-b210-57ef001204f2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:05.376419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d01adde2-472f-47ec-b210-57ef001204f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:05.462606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 5/11] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:05.549132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a558b-5d2f-46ee-9060-5583e494ac78 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:05.549425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a558b-5d2f-46ee-9060-5583e494ac78 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:05.549707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a558b-5d2f-46ee-9060-5583e494ac78 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:05.551042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 7/12] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:05.557062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:05.557347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:05.557621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:05.576485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:05.577666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:05.594088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:05.645886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:05.741451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a558b-5d2f-46ee-9060-5583e494ac78 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:05.885303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a558b-5d2f-46ee-9060-5583e494ac78 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:05.909804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:05.923518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:05.924684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:05.924978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:05.925260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:05.937706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:05.947465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:05.949187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:05.950749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 8/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:05.956378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:05.990729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:06.021460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98af9d-0640-4c98-b88b-e5184ccfd044 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.056150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.056839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.057147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.057670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.073329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c92277-854f-491c-8608-6e09279b6d4b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.081128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:06.107998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.108617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.108901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.109185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.109855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:06.110162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.111571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.124156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 9/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:06.129961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:06.130759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.132287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.223283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:06.230348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b4935-6a74-47ab-8143-c9b9c437be9c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.233577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 7/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 14:27:06.239522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:06.264988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.265931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.266506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.266799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.268766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.270221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.271840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 10/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:06 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:06.277744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:06.292291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:06.342266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06ae5-b921-4435-9ba4-17034c80a38a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.376719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.377389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.377634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.377912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.379575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34272bb1-e985-4274-b314-25f47a06d4df None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.389479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.390954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:27:06.408735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:06.409745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:27:06.410591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:27:06.410591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:27:06.410591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:06.410591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 8/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:06.414939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.415664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.415947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.416227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.416548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:06.417462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.418897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.420489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 11/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:06.426074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:06.461262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:06.523914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bd3ae-a402-495c-942f-c368c506378f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.526486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:06.531915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79cc9b-aff6-417b-8cfb-9ed136bf1904 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:06.558095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.558709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.558993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.559270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.559971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:06.560279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.561700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466e7c-8c54-4e89-be8a-eda44f24a6bb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.566070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:06.566672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:06.566953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:06.567227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:06.567974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.domain.id=default, user.id=c13c46ea6a164631878622a88f432086) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:06.568285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:06.569698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f6d4c-e242-4460-9845-07ca275a242a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:06.578181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 12/20] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Sep 7 14:27:06 2022] GET /identity/v3/role_assignments?user.id=c13c46ea6a164631878622a88f432086&scope.domain.id=default&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:06.579071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 9/21] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:09.091266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68328ee-c133-493c-a983-3d33f22ae78f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.092314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68328ee-c133-493c-a983-3d33f22ae78f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.092847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68328ee-c133-493c-a983-3d33f22ae78f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.094384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 13/22] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:09.105611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034fce0-a2b3-4227-8e96-b93045fd462e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.106086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034fce0-a2b3-4227-8e96-b93045fd462e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.106181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034fce0-a2b3-4227-8e96-b93045fd462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.137661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4034fce0-a2b3-4227-8e96-b93045fd462e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:09.138866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4034fce0-a2b3-4227-8e96-b93045fd462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:09.236889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 10/23] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:09.302033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27478-1f2e-425a-be73-d43f6e9737fd None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.302703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27478-1f2e-425a-be73-d43f6e9737fd None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.303180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27478-1f2e-425a-be73-d43f6e9737fd None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.305109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 14/24] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:09.310918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a838838-2525-4f40-94a9-b20ca3984655 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.311208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a838838-2525-4f40-94a9-b20ca3984655 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.311514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a838838-2525-4f40-94a9-b20ca3984655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.340822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2a838838-2525-4f40-94a9-b20ca3984655 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:09.342041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2a838838-2525-4f40-94a9-b20ca3984655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:09.444695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 11/25] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:09.611628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ba90-10a9-41ad-bb55-63c17e10af84 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.612303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ba90-10a9-41ad-bb55-63c17e10af84 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.612811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ba90-10a9-41ad-bb55-63c17e10af84 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.614342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 15/26] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:09.620718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.621005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.621285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.625532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600cb8-298f-4cfe-9314-5c9d977a6a89 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.626064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600cb8-298f-4cfe-9314-5c9d977a6a89 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.626545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600cb8-298f-4cfe-9314-5c9d977a6a89 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.628201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 16/27] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:09.633899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:09.634474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:09.634952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:09.647842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:09.651396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:09.665365 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG passlib.handlers.bcrypt [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81762) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 14:27:09.666035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG passlib.handlers.bcrypt [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81762) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 14:27:09.683735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:09.738431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:09.740535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:09.832732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 12/28] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:09.833598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:09.854998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 17/29] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:09.959222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:09.984100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9715ce-9003-4cfe-9793-ff6f6805928b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.016069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:10.048896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.049554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.049840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.050124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.076310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:10.087867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:10.088921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:10.089703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:10.098983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 13/30] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:10.109907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:10.140599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:10.161701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47e024-56d7-4c64-8794-2c4b50b4f616 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.231996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.232798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.233087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.233369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.234221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:10.235684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:10.287547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ce90b-6d1d-4045-83fd-6272e82f9f68 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.323986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.324599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.324884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.325217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.325889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:10.326249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:10.327672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:10.341428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 14/31] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:10.342499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:10.426529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:10.450723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0d8d9-28de-44e5-95e3-d7a2a857e232 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.489142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.490042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.490494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.490946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.502319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:10.504059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:27:10.519922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:10.520843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:27:10.521652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:27:10.521652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:27:10.521652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:10.524055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 15/32] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:10.525232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:10.532243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 18/33] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Sep 7 14:27:09 2022] POST /identity/v3/roles => generated 225 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:10.533429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:10.655043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:10.677741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54954dd-b7d4-4009-88a3-24645157b516 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.732712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5976a4-8767-4fd6-bf53-94409f88af9f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.754317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.754899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.755201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.755503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.757224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:10.759490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:10.761484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 19/34] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:10 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:10.762144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:10.786458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:10.797922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.798643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.798974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.799257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.803920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:10.803920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:10.909330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d96f0-0a0c-4d95-98ce-940822ca3449 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:10.959800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:10.962091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:10.962584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:10.963009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:10.963869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:10.964325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:10.966103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:10.990261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 20/35] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:10.991332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:11.008689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:11.033584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 16/36] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Sep 7 14:27:10 2022] POST /identity/v3/roles => generated 219 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:11.036611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:11.111468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af344-4485-407a-9fd0-94997d1af141 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:11.154325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180cf0-ae10-47f1-9906-4e63f2855e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:11.154998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180cf0-ae10-47f1-9906-4e63f2855e4d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.155285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180cf0-ae10-47f1-9906-4e63f2855e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.155618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180cf0-ae10-47f1-9906-4e63f2855e4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.156919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d180cf0-ae10-47f1-9906-4e63f2855e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:11.158414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d180cf0-ae10-47f1-9906-4e63f2855e4d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:11.160091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 21/37] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:11.161391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95400f4-374f-419c-9532-57e61264605b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.161681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95400f4-374f-419c-9532-57e61264605b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.161964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95400f4-374f-419c-9532-57e61264605b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.163417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 22/38] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:11.164915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b36fe-cf69-4440-b3bc-9094e56b4608 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.165974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b36fe-cf69-4440-b3bc-9094e56b4608 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.165974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b36fe-cf69-4440-b3bc-9094e56b4608 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.166916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 23/39] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:11.167750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b36fe-cf69-4440-b3bc-9094e56b4608 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:11.274288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438a7a7-9d2f-4dfc-8ef9-4c311e779c09 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:11.276833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:11.299565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b36fe-cf69-4440-b3bc-9094e56b4608 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:11.315599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52727d-e3da-4b64-9b54-95acc1c6acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:11.316225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52727d-e3da-4b64-9b54-95acc1c6acfa None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.316514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52727d-e3da-4b64-9b54-95acc1c6acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.316796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52727d-e3da-4b64-9b54-95acc1c6acfa None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.317458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52727d-e3da-4b64-9b54-95acc1c6acfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:11.319043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52727d-e3da-4b64-9b54-95acc1c6acfa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:11.335233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c051-752a-419f-9143-b848465ac834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:11.336308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c051-752a-419f-9143-b848465ac834 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.336587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c051-752a-419f-9143-b848465ac834 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.336861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c051-752a-419f-9143-b848465ac834 None admin] PATH_INFO: `/v3/domains/default/users/c13c46ea6a164631878622a88f432086/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.338858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044c051-752a-419f-9143-b848465ac834 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c13c46ea6a164631878622a88f432086, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:11.340349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044c051-752a-419f-9143-b848465ac834 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:11.427265 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 17/40] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:27:11 2022] POST /identity/v3/projects => generated 301 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:11.428609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.428911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.429270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.450178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:11.451839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:11.455836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 24/41] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Sep 7 14:27:11 2022] PUT /identity/v3/domains/default/users/c13c46ea6a164631878622a88f432086/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:11.457229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:11.459226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:11.459226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:11.478985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:11.480693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:11.528035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:11.575086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 18/42] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:11.575814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 25/43] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:11.851832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:11.854942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:11.933690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:11.965098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5674e-ff06-4611-af01-345b5c979e3f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:11.965354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbfa91-d179-4004-84dc-b529d23537c9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:12.003318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fff58b-2d12-4f0c-ad96-64864c534366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:12.003984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff58b-2d12-4f0c-ad96-64864c534366 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:12.004277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff58b-2d12-4f0c-ad96-64864c534366 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:12.004561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff58b-2d12-4f0c-ad96-64864c534366 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:12.005249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fff58b-2d12-4f0c-ad96-64864c534366 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:12.006200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:12.006662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fff58b-2d12-4f0c-ad96-64864c534366 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:12.006844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:12.007132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:12.007533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:12.008983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:12.010435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:12.012447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 26/44] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:12.017743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:12.073287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 19/45] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Sep 7 14:27:11 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:12.131581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc753-4a13-4e33-a785-148d41706c3f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:12.171340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26bca8-45d6-47bb-97bd-6b52e6700ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:12.172003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bca8-45d6-47bb-97bd-6b52e6700ab5 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:12.172296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bca8-45d6-47bb-97bd-6b52e6700ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:12.172572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bca8-45d6-47bb-97bd-6b52e6700ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:12.173273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26bca8-45d6-47bb-97bd-6b52e6700ab5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:12.174898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26bca8-45d6-47bb-97bd-6b52e6700ab5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:12.195889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:12.292864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 27/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:27:12 2022] POST /identity/v3/projects => generated 312 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:27:13.717826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abce77-94e4-4df6-9101-587362da8252 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:13.718387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abce77-94e4-4df6-9101-587362da8252 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:13.718511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abce77-94e4-4df6-9101-587362da8252 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:13.720207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 20/47] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:13.725733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:13.726259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:13.726391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:13.853151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:13.854364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:13.926241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 28/48] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:14.203524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abce77-94e4-4df6-9101-587362da8252 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:14.236423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:14.321040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abce77-94e4-4df6-9101-587362da8252 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:14.358404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b6e6f-65cb-4880-bf87-ab4bf7cd1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:14.359039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6e6f-65cb-4880-bf87-ab4bf7cd1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.359320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6e6f-65cb-4880-bf87-ab4bf7cd1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.359626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6e6f-65cb-4880-bf87-ab4bf7cd1bb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.370289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b6e6f-65cb-4880-bf87-ab4bf7cd1bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c30b6e6f-65cb-4880-bf87-ab4bf7cd1bb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:14.375179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:14.376264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:14.377030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 21/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:14.383989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:14.489479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88470-6c3d-4d45-b3a5-0e5f038897c6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:14.512538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:14.514792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1df147-c272-4320-8d08-c631bd52b1d9 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.515082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1df147-c272-4320-8d08-c631bd52b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.515367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1df147-c272-4320-8d08-c631bd52b1d9 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.516794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 22/50] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:14.521866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.528282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.528282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.528518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:14.528518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.528518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.528518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.528888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:14.528888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:14.528888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:14.536775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 29/51] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:14.542475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:14.542607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:14.543761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:14.615061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 23/52] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:14.645353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77396b-997e-46f5-8892-2c5779e183f0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:14.680911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:14.681552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.681834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.682110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.683256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:14.684803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:14.686463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 30/53] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:14 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:14.692084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:14.715962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:14.793909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366991-6826-49df-be5b-2fd39eda9b11 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:14.828795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:14.829428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.829714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.829990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.831094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:14.832592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:14.834159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 24/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:14.840815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:14.885352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:14.894950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:14.945077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984e0f5-24ea-402d-a2fa-bc1e04d9f553 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:14.978680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:14.979973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:14.980590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:14.980874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:14.981151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:14.981883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.domain.id=default, user.id=c13c46ea6a164631878622a88f432086) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:14.982493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:14.983660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:14.989658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 31/55] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Sep 7 14:27:14 2022] GET /identity/v3/role_assignments?user.id=c13c46ea6a164631878622a88f432086&scope.domain.id=default&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:14.990606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ab7e6-9a72-4f40-a899-04af38bd5de1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:15.028404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216b23c-eb7b-4b7a-973c-5bf4936058ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:15.029062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216b23c-eb7b-4b7a-973c-5bf4936058ce None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:15.029342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216b23c-eb7b-4b7a-973c-5bf4936058ce None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:15.029618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216b23c-eb7b-4b7a-973c-5bf4936058ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:15.030841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216b23c-eb7b-4b7a-973c-5bf4936058ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:15.032358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216b23c-eb7b-4b7a-973c-5bf4936058ce None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:15.033996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 25/56] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:15.040190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:15.152167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710b13-6b19-4eec-8791-ceb8b87c1b3b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:15.169435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:15.189510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36acdf-24df-415f-83dd-a273c239e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:15.190156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36acdf-24df-415f-83dd-a273c239e1ce None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:15.190447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36acdf-24df-415f-83dd-a273c239e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:15.190786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36acdf-24df-415f-83dd-a273c239e1ce None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:15.191399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36acdf-24df-415f-83dd-a273c239e1ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:15.192915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36acdf-24df-415f-83dd-a273c239e1ce None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:15.278312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 32/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Sep 7 14:27:15 2022] POST /identity/v3/projects => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:17.440820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5af696-7ee1-40cd-91a3-dfc2fd26e2c7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:17.441777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5af696-7ee1-40cd-91a3-dfc2fd26e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:17.441777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5af696-7ee1-40cd-91a3-dfc2fd26e2c7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:17.442746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 26/58] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:17.448275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:17.448676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:17.448844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:17.467187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:17.468427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:17.533173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 33/59] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:17.805176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5af696-7ee1-40cd-91a3-dfc2fd26e2c7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:17.905909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5af696-7ee1-40cd-91a3-dfc2fd26e2c7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:17.939816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4da0-1daf-47c4-afb1-b6972adada95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:17.940445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4da0-1daf-47c4-afb1-b6972adada95 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:17.940723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4da0-1daf-47c4-afb1-b6972adada95 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:17.940996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4da0-1daf-47c4-afb1-b6972adada95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:17.942089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d4da0-1daf-47c4-afb1-b6972adada95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:17.943565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d4da0-1daf-47c4-afb1-b6972adada95 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:17.945721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 27/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:17.951280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:18.043815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:18.047529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0c31f-1068-4cba-8a67-7825cfc46fa5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:18.081059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b9356-0a01-407f-8d58-6ea70df6d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:18.081609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9356-0a01-407f-8d58-6ea70df6d5fc None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:18.081958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9356-0a01-407f-8d58-6ea70df6d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:18.082242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9356-0a01-407f-8d58-6ea70df6d5fc None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:18.082895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9356-0a01-407f-8d58-6ea70df6d5fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:18.084370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9356-0a01-407f-8d58-6ea70df6d5fc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:18.180866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 34/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:17 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:21.369208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f9b8-97d6-4332-a70b-bf10a709302b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:21.370219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f9b8-97d6-4332-a70b-bf10a709302b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:21.370752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f9b8-97d6-4332-a70b-bf10a709302b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:21.372628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 28/62] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:21.378575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b1cad-74f7-4845-820d-29903b282a90 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:21.379585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b1cad-74f7-4845-820d-29903b282a90 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:21.380090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b1cad-74f7-4845-820d-29903b282a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:21.405964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-852b1cad-74f7-4845-820d-29903b282a90 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:21.407569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-852b1cad-74f7-4845-820d-29903b282a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:21.500685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 35/63] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:21.794868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da14d4-8a4c-4490-bec4-6234b8fbfc34 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:21.795577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da14d4-8a4c-4490-bec4-6234b8fbfc34 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:21.796069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da14d4-8a4c-4490-bec4-6234b8fbfc34 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:21.797904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 29/64] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:21.803141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc106b-1696-4213-b456-961cc2c7c80d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:21.803724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc106b-1696-4213-b456-961cc2c7c80d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:21.804970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc106b-1696-4213-b456-961cc2c7c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:21.829322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-13dc106b-1696-4213-b456-961cc2c7c80d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:21.830863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-13dc106b-1696-4213-b456-961cc2c7c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:21.874429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da14d4-8a4c-4490-bec4-6234b8fbfc34 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:21.911836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:21.931410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 36/65] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:21.932864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2a9b-d9fd-4643-85e3-27d2ea8317e9 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:21.933044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2a9b-d9fd-4643-85e3-27d2ea8317e9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:21.933495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2a9b-d9fd-4643-85e3-27d2ea8317e9 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:21.935016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 37/66] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:21.941099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f3f4-3fc5-4d93-85a7-1f2b5d946b1d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:21.941591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f3f4-3fc5-4d93-85a7-1f2b5d946b1d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:21.942016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4f3f4-3fc5-4d93-85a7-1f2b5d946b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:21.962949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-93f4f3f4-3fc5-4d93-85a7-1f2b5d946b1d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:21.964444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-93f4f3f4-3fc5-4d93-85a7-1f2b5d946b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:21.975313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.045097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da14d4-8a4c-4490-bec4-6234b8fbfc34 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.064370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 38/67] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:22.070567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060d05-f036-497a-8d7a-03e0e1f9f19f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.071772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060d05-f036-497a-8d7a-03e0e1f9f19f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.072273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060d05-f036-497a-8d7a-03e0e1f9f19f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.074107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 39/68] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:22.079551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802962ea-cded-4445-b393-5b8478cf01df None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.080060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802962ea-cded-4445-b393-5b8478cf01df None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.081007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802962ea-cded-4445-b393-5b8478cf01df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.103306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-802962ea-cded-4445-b393-5b8478cf01df None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:22.105067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-802962ea-cded-4445-b393-5b8478cf01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:22.110508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.111206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.111521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.111803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.138283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:22.143290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:22.144213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:22.145005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:22.151743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 30/69] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:22.153091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.192053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 40/70] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:22.240941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802962ea-cded-4445-b393-5b8478cf01df None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.297840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.316045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809651-0828-4d36-91f0-bc00012754b1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.357527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.358513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.359026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.359537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.360431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:22.360961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:22.362606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:22.372852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 31/71] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:22.373859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.396812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.424667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802962ea-cded-4445-b393-5b8478cf01df None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.463507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.464434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.464934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.465430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.476776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:22.482369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:22.483264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:22.484453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 41/72] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:22.485424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8c6e-4399-4c36-af6a-b6ff6c5d486d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.485496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.521296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b035b2-ba8a-4da2-8d25-2679a45a809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.521939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b035b2-ba8a-4da2-8d25-2679a45a809f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.522226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b035b2-ba8a-4da2-8d25-2679a45a809f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.522506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b035b2-ba8a-4da2-8d25-2679a45a809f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.533922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b035b2-ba8a-4da2-8d25-2679a45a809f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-81b035b2-ba8a-4da2-8d25-2679a45a809f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:22.539806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:22.540902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:22.541854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 32/73] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:22.542533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69c878-d3e8-4119-9f2e-71811a791400 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.542604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69c878-d3e8-4119-9f2e-71811a791400 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.542892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69c878-d3e8-4119-9f2e-71811a791400 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.544177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 33/74] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:22.544960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69c878-d3e8-4119-9f2e-71811a791400 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.556086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.596434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3964ab-0324-4f17-9b54-b4f7b414d213 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.630579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.631211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.631528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.631803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.634249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.647405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:22.649757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:22.651428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 42/75] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:22.656319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.656647 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69c878-d3e8-4119-9f2e-71811a791400 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.693231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.693845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.694134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.694418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.696032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:22.696341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:22.697741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:22.706427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 34/76] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:22.707231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.763045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d32d2-7d03-45c0-b3f7-a1d1ae7c3049 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.774559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.798216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28c611-d975-4d49-a61b-e07d826bff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.798786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c611-d975-4d49-a61b-e07d826bff6a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.799075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c611-d975-4d49-a61b-e07d826bff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.799357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c611-d975-4d49-a61b-e07d826bff6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.800511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28c611-d975-4d49-a61b-e07d826bff6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:22.809994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28c611-d975-4d49-a61b-e07d826bff6a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:22.809994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 43/77] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:22.809994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.809994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.809994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.810353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552fa01-c3c6-4c94-85b7-f4c24f23813c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:22.824311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:22.825628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:22.843219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:22.843862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:22.844142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:22.844417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:22.845142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:22.845445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:22.846817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:22.855636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 35/78] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:22.856958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.889207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:22.900901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 44/79] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:22.901728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:22.973289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd127650-f03d-4bbf-b65a-1d468d0e04c0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.004097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.009074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fbb1f-958a-4774-bf52-3ac257cd0c1c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.010752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.014932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.014932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.014932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.045810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.046500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.046795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.047192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.048465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.049914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.056751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 45/80] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:23.056751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.086716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.088147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.118437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.164877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227fb4-32b3-4886-840d-e09e5db45669 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.195692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 36/81] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:23.196568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.199460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.200081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.200374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.200658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.201320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.202760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.229072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.282472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 46/82] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:23 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:23.283412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.300727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f334b6f-97a2-4404-b38e-83ac2c3af1d7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.346591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.347173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.347492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.347776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.348992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.350473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.352790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 37/83] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:23.353407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.416432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac081e7-c77a-4c36-9d5c-c2550096d26f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.432873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.456083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.456714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.456999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.457281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.470453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.476322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e00e-f627-4df6-87c9-226883dfdf91 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.516098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.517362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.517886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.518392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.531468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:23.536512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:23.537438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:23.538776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 38/84] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:23.539450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.544103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.545629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.679191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c53922-6f87-4ee4-97c7-4398f5fdd465 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.684747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 47/85] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:23.685624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.705197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.714440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.715089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.715402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.715702 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.716870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.718338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.720186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 39/86] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:23.720796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.778739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:23.801824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693a663-140a-4123-a53f-0887de0d8232 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.850189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.850909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.851205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.851527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.871306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e976e31-92ed-4202-8fe2-ce623f6d40db None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:23.908449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:23.909290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:23.909714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:23.910160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:23.910966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:23.911449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.913007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.922334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 40/87] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:23.928278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:23.945779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:23.947665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:23.979789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.029456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.044125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b596e-7da7-467a-9533-ea6fb87bafc5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.083838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.084766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.085324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.085699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 48/88] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:24.086304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.086610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.088034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.090733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.092910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 41/89] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:23 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:24.093921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.214869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20825d-6aeb-480a-8ed1-baaae07eadf5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.231340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91652993-d392-41d5-b381-bed7be2335e4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.235489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.260240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.261605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.262286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.262935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.264048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=481499c89d4842f891010bc0ee49f392) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:24.264677 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.266398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.273421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.273751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.273937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 49/90] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/role_assignments?user.id=481499c89d4842f891010bc0ee49f392&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=8d82548844954170a8a5017f7a605f61 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:24.274095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.274377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.275397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.276005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.277685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.279705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 42/91] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:24.287075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.325156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.412865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44deeb83-339a-4a19-ad6e-3164437f1360 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.457434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.458078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.458396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.458652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.461596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.463146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.465779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 50/92] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:24.472246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.509818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed649b-1c9e-41e0-8926-827e35b7fff4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.531657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.576339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.576966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.577255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.577539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.578281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=c13c46ea6a164631878622a88f432086) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:24.578600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.588242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.592948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a829-49de-48bb-8373-aa7baabae2e0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.603569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 43/93] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/role_assignments?user.id=c13c46ea6a164631878622a88f432086&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:24.604670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.634694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.635683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.636193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.636836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.717575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.719527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.730465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.743943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613062ca-8888-46f4-9b2d-89170741c9e6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:24.773141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:24.780808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:24.781451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:24.781744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:24.782028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:24.782816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] RBAC: Adding query filter params (role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=481499c89d4842f891010bc0ee49f392) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:24.783094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:24.784726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:24.790989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 44/94] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/role_assignments?user.id=481499c89d4842f891010bc0ee49f392&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:24.840292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 51/95] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:24.846246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:24.999884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef506-d85a-40a2-bdb5-d2c49b86bfa2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:25.053494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb600-79ca-48d8-b1c5-7a5184e605c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:25.054285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb600-79ca-48d8-b1c5-7a5184e605c0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:25.054629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb600-79ca-48d8-b1c5-7a5184e605c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:25.054909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb600-79ca-48d8-b1c5-7a5184e605c0 None admin] PATH_INFO: `/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:25.056141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb600-79ca-48d8-b1c5-7a5184e605c0 None admin] RBAC: Authorizing `identity:get_project(project_id=21845ec15b7e4f3fa21b96a84b0225b2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:25.057819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb600-79ca-48d8-b1c5-7a5184e605c0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:25.059669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 45/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:24 2022] GET /identity/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:25.065927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:25.198443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ccdd-89d4-4860-a9aa-8442cf747fea None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:25.236268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:25.236889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:25.237181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:25.237464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:25.238200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=21845ec15b7e4f3fa21b96a84b0225b2, user.id=481499c89d4842f891010bc0ee49f392) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:25.238520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:25.240027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0708ba-a1b9-47d3-92b8-3c3c24804756 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:25.251589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 52/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:25 2022] GET /identity/v3/role_assignments?user.id=481499c89d4842f891010bc0ee49f392&scope.project.id=21845ec15b7e4f3fa21b96a84b0225b2&role.id=8d82548844954170a8a5017f7a605f61 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:26.009622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66ce3-0c76-4a01-a360-b3d7a273659c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:26.010128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66ce3-0c76-4a01-a360-b3d7a273659c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:26.010202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a66ce3-0c76-4a01-a360-b3d7a273659c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:26.011546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 46/98] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:26.017030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb85f-d1b9-4393-8ab5-c20c39113172 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:26.017436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb85f-d1b9-4393-8ab5-c20c39113172 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:26.017626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb85f-d1b9-4393-8ab5-c20c39113172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:26.044467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5a2bb85f-d1b9-4393-8ab5-c20c39113172 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:26.045688 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5a2bb85f-d1b9-4393-8ab5-c20c39113172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:26.048929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:26.130681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 53/99] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:26.453335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278ec1-0788-4fc7-aa1b-92ba33100d77 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:26.453705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278ec1-0788-4fc7-aa1b-92ba33100d77 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:26.453886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278ec1-0788-4fc7-aa1b-92ba33100d77 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:26.455395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 47/100] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:26.461175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:26.461466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:26.461748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:26.486829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:26.488044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:26.519538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278ec1-0788-4fc7-aa1b-92ba33100d77 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:26.552349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:26.606217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 54/101] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:26.663860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278ec1-0788-4fc7-aa1b-92ba33100d77 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:26.709698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:26.711202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:26.711528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:26.711790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:26.712980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:26.714479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:26.716259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 48/102] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:26.723912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:26.812309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:26.851825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87b6b-f458-4a70-871d-99baaa9028d2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:26.894862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:26.895504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:26.895792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:26.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:26.896727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:26.898870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:26.949247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:27.008851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 55/103] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:27:26 2022] POST /identity/v3/projects => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:27.050579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:27.067091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d36d8-c09e-47ad-81e4-7323c887513f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:27.108983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:27.109643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:27.109928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:27.110208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:27.122419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:27.127450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:27.128298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:27.129073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 49/104] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:27.136986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:27.308735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a747c-6143-4001-b443-9460aa2a9e31 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:27.350397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:27.363391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:27.363391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:27.363669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:27.363901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:27.364534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:27.364846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:27.366299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5800c-7170-44cf-bf93-5ec7480f97b5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:27.378662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 56/105] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:27.385477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:27.532781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4e5d-adf1-43de-b21e-ab54cf511e32 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:27.556760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7514a-c3f7-40dd-b287-648ca9eea937 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:27.557458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7514a-c3f7-40dd-b287-648ca9eea937 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:27.558037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7514a-c3f7-40dd-b287-648ca9eea937 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:27.559687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 57/106] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:27.565438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:27.566006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:27.566503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:27.568987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:27.570365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:27.570365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:27.570365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] PATH_INFO: `/v3/users/4ad678f37d6b40e69bac9858a28de2c9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:27.586244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad678f37d6b40e69bac9858a28de2c9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:27.587976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:27.588102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:27.589493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:27.589919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 50/107] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:27 2022] GET /identity/v3/users/4ad678f37d6b40e69bac9858a28de2c9 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:27.595294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:27.604485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:27.674226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 58/108] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:27.728593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd632-474c-49fa-ae7b-9422cbdab360 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:27.784377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:27.785000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:27.785290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:27.785573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:27.884550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:27.885973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:27.894267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:28.006350 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:28.081097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 51/109] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:28.112176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:28.236921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ea7a4-e77c-4896-85f3-b573710743da None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:28.276511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:28.329332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81bca9-cc7c-42d6-bb83-9a5b2727a36a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:28.339742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:28.341597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:28.342266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.342555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.342839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.362996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:28.368843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:28.369741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:28.370518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 59/110] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:28.376746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:28.401971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:28.402624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.402912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.403192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.404483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:28.405966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:28.407646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 52/111] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:28 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:28.417608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:28.549566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4fb7f-b425-41c3-be9a-c47245160e40 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:28.549763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeecc71-cc11-4569-8259-a42581992706 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:28.591185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:28.591987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.592094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:28.592304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.592558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.592657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.592871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.593151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.593244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:28.593541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:28.593877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] RBAC: Adding query filter params (role.id=19202e2098d24e4da79425e52e0a8428, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=4ad678f37d6b40e69bac9858a28de2c9) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:28.594188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:28.594928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d803-ba40-4072-922a-f9e970aad538 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:28.595646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01004c2d-af12-4d5a-8d51-1d52a58819a0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:28.603094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 53/112] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:28 2022] GET /identity/v3/role_assignments?user.id=4ad678f37d6b40e69bac9858a28de2c9&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=19202e2098d24e4da79425e52e0a8428 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:28.604464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751cdc-8c3a-490e-820d-ca8a90ef555a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.604753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751cdc-8c3a-490e-820d-ca8a90ef555a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.605035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751cdc-8c3a-490e-820d-ca8a90ef555a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.605145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 60/113] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:28.606378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b338-d3fa-4590-9f28-6bb711eeaafb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.606742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b338-d3fa-4590-9f28-6bb711eeaafb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.607037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b338-d3fa-4590-9f28-6bb711eeaafb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.608335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 61/114] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:28.609204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 54/115] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:28.615627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b338-d3fa-4590-9f28-6bb711eeaafb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:28.617680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667d7b-731f-444b-8001-0b5a543e2f94 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.617974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667d7b-731f-444b-8001-0b5a543e2f94 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.618255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667d7b-731f-444b-8001-0b5a543e2f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.667167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e5667d7b-731f-444b-8001-0b5a543e2f94 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:28.668499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e5667d7b-731f-444b-8001-0b5a543e2f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:28.695517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:28.730915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:28.813654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 55/116] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:28.814794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.815092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.815487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.824546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b338-d3fa-4590-9f28-6bb711eeaafb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:28.837424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:28.839092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:28.863970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f720c6-dbc6-43f6-879d-c1a5ceab0411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:28.864622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f720c6-dbc6-43f6-879d-c1a5ceab0411 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.864912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f720c6-dbc6-43f6-879d-c1a5ceab0411 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.865201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f720c6-dbc6-43f6-879d-c1a5ceab0411 None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.866385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f720c6-dbc6-43f6-879d-c1a5ceab0411 None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:28.869186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f720c6-dbc6-43f6-879d-c1a5ceab0411 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:28.874954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 62/117] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:28 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:28.874954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93655fe-88f1-4388-835d-83cf5f6e1a69 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.874954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93655fe-88f1-4388-835d-83cf5f6e1a69 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.874954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93655fe-88f1-4388-835d-83cf5f6e1a69 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.874954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 63/118] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:28.885336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:28.885628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:28.885912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:28.921484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:28.923995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:28.953128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 56/119] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:28.954951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.103605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 64/120] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:29.134247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:29.141519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18b0e-f7d7-4c01-85b3-25a062bd0b2b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:29.193210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:29.193855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:29.194140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:29.194513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:29.200083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:29.201556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:29.203541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 57/121] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:28 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:29.209299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.258239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:29.295880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.373592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422ff26-907a-4e20-bbed-fc0c4905cd62 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:29.438333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:29.439012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:29.439296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:29.439596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/481499c89d4842f891010bc0ee49f392/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:29.443261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5, user_id=481499c89d4842f891010bc0ee49f392, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:29.445381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:29.471136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e5f75-cf78-49a2-beea-0f7c018a94dd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:29.508611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:29.509249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:29.509594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:29.509875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:29.520721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:29.526521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:29.530189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 58/122] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:29.530953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.564526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 65/123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:29 2022] PUT /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/481499c89d4842f891010bc0ee49f392/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:29.565806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.569975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:29.743831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1ae4a-c6b8-46f9-9512-18519f029f6a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:29.775747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:29.790328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5722b9-f3cb-41fd-98c7-188a93b9d4e7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:29.804728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:29.805465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:29.805849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:29.806203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:29.821488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:29.828751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:29.836097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 59/124] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:29.837015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.837702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:29.837702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:29.837702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:29.837702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:29.846304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:29.851954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:29.854040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:29.856139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 66/125] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:29.863500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:29.943154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:29.963602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fc089-5ab1-413d-a8a3-1ed20769b12d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:29.977839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d39c38-6678-4f13-ac8d-dc073b9399eb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.002107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.003042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.003641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.004175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.005047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:30.005558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.007385 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.016766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 60/126] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.022943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.029082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.029717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.030005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.030285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.030976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:30.031285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.032698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.050430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 67/127] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.053000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.091291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:30.197519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58de61-1fbf-41fe-9e68-49bef7d460e3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.206871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3c89-fd7c-46f4-92c8-524c03520133 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.247366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.248486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.248981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.249467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.251062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.252956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.255033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 68/128] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.260592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.268851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.270516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.270516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.270516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.270793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:30.271004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.272644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.290905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 61/129] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.299178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.328856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:30.419414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:30.443139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19207-57f2-49f4-b56c-c5903f14eb35 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.451713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf830e1f-9e21-44f0-bd8e-92193ba0ed58 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.481249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.481903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.482194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.482475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.483842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.485299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.486881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 69/130] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.487676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.493820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65d6e0-7bbd-4d68-ab57-ec5efa53d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.494487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65d6e0-7bbd-4d68-ab57-ec5efa53d17e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.494777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65d6e0-7bbd-4d68-ab57-ec5efa53d17e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.495059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65d6e0-7bbd-4d68-ab57-ec5efa53d17e None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.496245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65d6e0-7bbd-4d68-ab57-ec5efa53d17e None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.497820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65d6e0-7bbd-4d68-ab57-ec5efa53d17e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.499986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 62/131] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.501217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a717d-7fc7-42a7-86c0-261d54a68db3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.501512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a717d-7fc7-42a7-86c0-261d54a68db3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.501791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a717d-7fc7-42a7-86c0-261d54a68db3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.507831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 63/132] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:30.508874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a717d-7fc7-42a7-86c0-261d54a68db3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.596293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9e9c0-14af-4a39-97d6-c58332cd9d56 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.599597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:30.628455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a717d-7fc7-42a7-86c0-261d54a68db3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.638862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.639879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.640464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.640942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.642324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.644217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.645998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 70/133] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.647910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.676466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c8d6-8162-4369-8ba5-7e5dc9154312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.677417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c8d6-8162-4369-8ba5-7e5dc9154312 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.679266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:30.680542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c8d6-8162-4369-8ba5-7e5dc9154312 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.681631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c8d6-8162-4369-8ba5-7e5dc9154312 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.684339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403c8d6-8162-4369-8ba5-7e5dc9154312 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.688177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403c8d6-8162-4369-8ba5-7e5dc9154312 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.698491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 64/134] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:30.698491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.698491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.698491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.732559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:30.734886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:30.779220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f3f76-6891-4753-a209-8bfcaa51c5ac None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:30.817250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:30.817917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:30.818204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:30.818487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/481499c89d4842f891010bc0ee49f392/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:30.820981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5, user_id=481499c89d4842f891010bc0ee49f392, role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:30.822708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:30.831892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 65/135] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:30.837354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.935367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 71/136] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:30 2022] PUT /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/481499c89d4842f891010bc0ee49f392/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:30.936608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:30.965910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:31.018583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac80bb-e1d9-4ad5-9908-943a3e490647 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:31.092638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:31.093271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.093557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.093891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] PATH_INFO: `/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.096174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=21845ec15b7e4f3fa21b96a84b0225b2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:31.097657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:31.101451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 66/137] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:30 2022] GET /identity/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2 => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:31.108864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:31.114504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:31.173428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9c09-84e0-44f0-9955-25604ab0f768 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:31.242237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:31.243309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.243309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.243594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/c13c46ea6a164631878622a88f432086/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.245630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5, user_id=c13c46ea6a164631878622a88f432086, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:31.247160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:31.258846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672624-49cf-4ed7-8d2e-f870d775d8a7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:31.298493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d67a-76e0-426f-9d40-32f03e8f7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:31.299207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d67a-76e0-426f-9d40-32f03e8f7a90 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.299549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d67a-76e0-426f-9d40-32f03e8f7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.299831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d67a-76e0-426f-9d40-32f03e8f7a90 None admin] PATH_INFO: `/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2/users/481499c89d4842f891010bc0ee49f392/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.301716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d67a-76e0-426f-9d40-32f03e8f7a90 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845ec15b7e4f3fa21b96a84b0225b2, user_id=481499c89d4842f891010bc0ee49f392, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:31.303210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d67a-76e0-426f-9d40-32f03e8f7a90 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:31.316893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 72/138] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:30 2022] PUT /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/c13c46ea6a164631878622a88f432086/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:31.318504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:31.387405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 67/139] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:31 2022] PUT /identity/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2/users/481499c89d4842f891010bc0ee49f392/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:31.391402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043696-b20e-436f-9cbc-9d09859b39d0 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.392020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043696-b20e-436f-9cbc-9d09859b39d0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.392728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043696-b20e-436f-9cbc-9d09859b39d0 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.396603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 68/140] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:31.415687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.416359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.416833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.427811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:31.456853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:31.458864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:31.524414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c893f-ba85-4c04-9aa7-546b4566d4c0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:31.574395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 69/141] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:31.575952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:31.576612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.576901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.577186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.578327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:31.579991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:31.581574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 73/142] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:31.587765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:31.723743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46769f-5e89-42bd-b8aa-5207a08cb108 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:31.762186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:31.762867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:31.763153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:31.763453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:31.764206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:31.765838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:31.778130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:31.900953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 70/143] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:31 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:27:32.028952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:32.044731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:32.168664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72764-9724-47ac-bee1-0eacc86a23c4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:32.217180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b8bc-f885-4061-8507-7c59698eae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:32.218248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b8bc-f885-4061-8507-7c59698eae23 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:32.218737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b8bc-f885-4061-8507-7c59698eae23 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:32.219215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b8bc-f885-4061-8507-7c59698eae23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:32.236388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b8bc-f885-4061-8507-7c59698eae23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-92e3b8bc-f885-4061-8507-7c59698eae23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:32.242492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:32.243453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:32.244680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 74/144] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:32.250084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:32.404432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0885-ff24-487f-95a3-63d2b77ca7e2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:32.451519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:32.452213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:32.452503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:32.452779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:32.453465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:32.453776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:32.455165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:32.460355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a59d7-70f8-43c8-8a38-635e0913d62d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:32.461202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a59d7-70f8-43c8-8a38-635e0913d62d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:32.461202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a59d7-70f8-43c8-8a38-635e0913d62d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:32.462667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 75/145] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:32.467875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 71/146] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:32.468247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:32.468532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:32.468955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:32.473595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:32.490479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:32.492000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:32.565976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:32.608857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:32.616679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b593-2923-4b2f-9eae-438959459782 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:32.624766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 76/147] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:32.672883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:32.672883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:32.672883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:32.672883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] PATH_INFO: `/v3/users/4ad678f37d6b40e69bac9858a28de2c9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:32.673225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad678f37d6b40e69bac9858a28de2c9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:32.673225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:32.674631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 72/148] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:32 2022] GET /identity/v3/users/4ad678f37d6b40e69bac9858a28de2c9 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:32.680522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:32.849678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981800d2-c701-43f5-8c7a-8f0001a47b21 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:32.899731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:32.900379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:32.900664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:32.900941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:32.902094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:32.903545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:32.905179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 77/149] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:32 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:32.911661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:33.057949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:33.066407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb113ee-bd56-4af4-8e5c-236991752076 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:33.100214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:33.132436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:33.136056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:33.136479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:33.138095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/4ad678f37d6b40e69bac9858a28de2c9/roles/19202e2098d24e4da79425e52e0a8428` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:33.143539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5, user_id=4ad678f37d6b40e69bac9858a28de2c9, role_id=19202e2098d24e4da79425e52e0a8428)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:33.145053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:33.172141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:33.206238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053765-5761-4a29-8412-32d6f637b602 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:33.233327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 73/150] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:32 2022] PUT /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/users/4ad678f37d6b40e69bac9858a28de2c9/roles/19202e2098d24e4da79425e52e0a8428 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:33.258333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:33.259006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:33.259293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:33.259585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:33.279127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:33.284527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:33.285427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:33.286261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 78/151] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:33.294046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:33.428281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b958522-f335-4cf9-a510-4eb52fe14f13 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:33.472341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:33.472894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:33.473177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:33.473452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:33.474131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:33.474441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:33.475991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:33.486699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 74/152] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:33.493733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:33.639122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df8fa0-af6a-4997-9e1a-363126253fd0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:33.671444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:33.683236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:33.683902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:33.684189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:33.684465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:33.687620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:33.689082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:33.690654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 79/153] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:33 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:33.697077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:33.776025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:33.847738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfaa29-a310-4cf6-a3cb-bc0879c72613 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:33.885159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:33.885786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:33.886072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:33.886347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:33.982407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:33.983931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:34.051159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:34.112268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 75/154] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:34.117187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:34.264469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b118-eeed-4d48-a381-9754eed3082a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:34.307125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af45ddb-bdfb-41a0-8980-2b937502fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:34.308138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45ddb-bdfb-41a0-8980-2b937502fc05 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:34.308698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45ddb-bdfb-41a0-8980-2b937502fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:34.309181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af45ddb-bdfb-41a0-8980-2b937502fc05 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:34.315391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af45ddb-bdfb-41a0-8980-2b937502fc05 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:34.317069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af45ddb-bdfb-41a0-8980-2b937502fc05 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:34.318928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 80/155] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:34 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:34.325335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:34.482728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc220382-c9ea-4fcd-98dc-ab9d78abf36e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:34.531587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:34.532208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:34.532491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:34.532763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:34.533507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=481499c89d4842f891010bc0ee49f392) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:34.533816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:34.535273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed837c-96f0-4f10-a2ba-1e31fb4f73e7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:34.544428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 76/156] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:34 2022] GET /identity/v3/role_assignments?user.id=481499c89d4842f891010bc0ee49f392&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=8d82548844954170a8a5017f7a605f61 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:34.651704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6678e-5779-41ef-8e8f-ac3ce6a56eec None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:34.652706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6678e-5779-41ef-8e8f-ac3ce6a56eec None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:34.653184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6678e-5779-41ef-8e8f-ac3ce6a56eec None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:34.654731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 81/157] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:34.672909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba21c6-f41f-4ce0-a525-04709d6ccaf6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:34.680107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba21c6-f41f-4ce0-a525-04709d6ccaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:34.680107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba21c6-f41f-4ce0-a525-04709d6ccaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:34.687962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:34.694885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f8ba21c6-f41f-4ce0-a525-04709d6ccaf6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:34.696263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f8ba21c6-f41f-4ce0-a525-04709d6ccaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:34.795399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 77/158] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:34.944949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4263e3-bd69-45ad-9cb3-d209c0ca3acb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:34.945257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4263e3-bd69-45ad-9cb3-d209c0ca3acb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:34.945520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4263e3-bd69-45ad-9cb3-d209c0ca3acb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:34.947140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 82/159] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:34.952680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3526-9893-4adb-90a6-251790869e0f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:34.952972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3526-9893-4adb-90a6-251790869e0f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:34.953252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3526-9893-4adb-90a6-251790869e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:34.976618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-679a3526-9893-4adb-90a6-251790869e0f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:34.977850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-679a3526-9893-4adb-90a6-251790869e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:35.061194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 78/160] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:35.121900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833ac37-4631-4a4a-98fe-f009cbc0cfa1 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:35.122252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833ac37-4631-4a4a-98fe-f009cbc0cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:35.122469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833ac37-4631-4a4a-98fe-f009cbc0cfa1 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:35.123854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 83/161] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:35.129565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:35.129856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:35.130136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:35.150080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:35.151281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:35.229466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:35.237094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 79/162] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:35.505820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833ac37-4631-4a4a-98fe-f009cbc0cfa1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:35.588225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:35.630023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833ac37-4631-4a4a-98fe-f009cbc0cfa1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:35.668711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:35.693175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:35.693814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:35.694184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:35.694566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:35.729055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:35.734444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:35.735480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:35.736290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:35.742452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 84/163] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:27:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:35.752337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:35.857816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c8008-d7f7-4bd6-bde7-f8c17b8b2671 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:35.953649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:35.953649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:35.953649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:35.954003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:35.981538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bac6-9fad-4034-980c-833e04539ce0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:35.982477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:35.987389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:35.988264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:35.989053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 80/164] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:35.989712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.042407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:36.071456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:36.072083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.072370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.072651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.073329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:36.073639 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:36.075015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:36.094844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 85/165] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:27:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:36.095941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.113529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:36.157527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b13b-5bc4-45ff-8c6c-f807232a93d3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:36.208683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:36.209345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.209746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.210727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.234447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:36.239353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:36.240240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:36.241084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 81/166] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:36.242677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.393632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71452c-8850-4b91-b309-a68abc1ba69c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:36.446726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3f3d-5707-439a-aad5-993679c4479d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:36.494447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:36.495071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.495356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.495660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.495764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:36.496342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:36.496652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:36.498023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:36.515359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 86/167] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:36.516233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.543618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:36.544270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.544555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.544833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.545986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:36.547487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:36.551402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 82/168] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:36 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:36.552232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.650236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:36.767599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa326d04-1765-45d4-ac48-bc3006831163 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:36.799032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f8dc-7122-4df8-a241-aee78eba8ee6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:36.825978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:36.826631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.826916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.827194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.829119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:36.830136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:36.831549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:36.856193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 87/169] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:36.857120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.876863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642143ed-976a-4943-9c05-5c0c6c9db0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:36.877507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642143ed-976a-4943-9c05-5c0c6c9db0fd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.877788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642143ed-976a-4943-9c05-5c0c6c9db0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.878064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642143ed-976a-4943-9c05-5c0c6c9db0fd None admin] PATH_INFO: `/v3/users/481499c89d4842f891010bc0ee49f392` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.879201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642143ed-976a-4943-9c05-5c0c6c9db0fd None admin] RBAC: Authorizing `identity:get_user(user_id=481499c89d4842f891010bc0ee49f392)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:36.880668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642143ed-976a-4943-9c05-5c0c6c9db0fd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:36.884729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 83/170] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:36 2022] GET /identity/v3/users/481499c89d4842f891010bc0ee49f392 => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:36.885970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c45ec-120b-49ac-9712-cee48d618e17 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:36.886252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c45ec-120b-49ac-9712-cee48d618e17 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:36.886525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c45ec-120b-49ac-9712-cee48d618e17 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:36.890035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 84/171] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:36.892368 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c45ec-120b-49ac-9712-cee48d618e17 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:36.995450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.056002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367535a-d964-41d2-a158-51e84abd9149 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:37.074091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.092663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c45ec-120b-49ac-9712-cee48d618e17 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:37.119723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c14fd-d185-4ce9-a25d-e358b5aaf30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:37.120353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c14fd-d185-4ce9-a25d-e358b5aaf30b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.120640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c14fd-d185-4ce9-a25d-e358b5aaf30b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.120924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c14fd-d185-4ce9-a25d-e358b5aaf30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.156667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:37.157645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.157931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.158263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] PATH_INFO: `/v3/users/c13c46ea6a164631878622a88f432086` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.159803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] RBAC: Authorizing `identity:get_user(user_id=c13c46ea6a164631878622a88f432086)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:37.161935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:37.164806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 85/172] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:36 2022] GET /identity/v3/users/c13c46ea6a164631878622a88f432086 => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:37.166410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:37.222345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c14fd-d185-4ce9-a25d-e358b5aaf30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:37.223800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c14fd-d185-4ce9-a25d-e358b5aaf30b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:37.290238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1772df-4e12-4998-9824-1909ce221519 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:37.313328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.328532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe834b-a998-4b5d-b25b-d1c0eef24e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:37.329137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe834b-a998-4b5d-b25b-d1c0eef24e6b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.329407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe834b-a998-4b5d-b25b-d1c0eef24e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.329676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe834b-a998-4b5d-b25b-d1c0eef24e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.340427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 88/173] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:37.341954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf667a1-3bde-4482-af00-47592ba21e5a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.342242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf667a1-3bde-4482-af00-47592ba21e5a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.342517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf667a1-3bde-4482-af00-47592ba21e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.360994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8cf667a1-3bde-4482-af00-47592ba21e5a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:37.362201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8cf667a1-3bde-4482-af00-47592ba21e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:37.364358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.406765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe834b-a998-4b5d-b25b-d1c0eef24e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:37.408260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe834b-a998-4b5d-b25b-d1c0eef24e6b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:37.439947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 89/174] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:37.441489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e2e8b-92fe-4363-9c46-e76187861e5e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.441869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e2e8b-92fe-4363-9c46-e76187861e5e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.442213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e2e8b-92fe-4363-9c46-e76187861e5e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.443881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 90/175] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:37.444663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e2e8b-92fe-4363-9c46-e76187861e5e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:37.533230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 86/176] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:37.534847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c0b4-2486-46b7-9624-4116bfceb1a1 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.535313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c0b4-2486-46b7-9624-4116bfceb1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.535789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c0b4-2486-46b7-9624-4116bfceb1a1 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.537369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 87/177] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:37.542031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c0b4-2486-46b7-9624-4116bfceb1a1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:37.564030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.568617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e2e8b-92fe-4363-9c46-e76187861e5e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:37.605367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fe664-e36f-4a44-8e25-a36d184349d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:37.605986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe664-e36f-4a44-8e25-a36d184349d0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.606269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe664-e36f-4a44-8e25-a36d184349d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.606584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe664-e36f-4a44-8e25-a36d184349d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.614817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.651852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c0b4-2486-46b7-9624-4116bfceb1a1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:37.681289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fe664-e36f-4a44-8e25-a36d184349d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:37.685579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fe664-e36f-4a44-8e25-a36d184349d0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:37.687399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ddff2-7949-4c24-ba2b-93e06e51c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:37.688046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ddff2-7949-4c24-ba2b-93e06e51c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.688330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ddff2-7949-4c24-ba2b-93e06e51c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.688605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ddff2-7949-4c24-ba2b-93e06e51c3c6 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.689708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ddff2-7949-4c24-ba2b-93e06e51c3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:37.691151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ddff2-7949-4c24-ba2b-93e06e51c3c6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:37.692812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 88/178] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:37 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:37.699608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.699890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.700166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.719329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:37.720550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:37.791626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 89/179] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:37.792472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:37.805548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 91/180] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:37.805548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670625b0-2a91-441d-93c8-e67e6c7166c1 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.805548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670625b0-2a91-441d-93c8-e67e6c7166c1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.805548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670625b0-2a91-441d-93c8-e67e6c7166c1 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.805548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 92/181] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:37.806874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.806874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.807039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.813793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.827463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:37.831345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:37.860544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:37.902401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 93/182] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:37.903263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:37.903392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bf811-f32f-4be5-b065-af6b3ed3f759 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:37.946837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:37.947491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:37.947770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:37.948089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] PATH_INFO: `/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:37.949212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] RBAC: Authorizing `identity:get_project(project_id=21845ec15b7e4f3fa21b96a84b0225b2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:37.950636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:37.952470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 90/183] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:37 2022] GET /identity/v3/projects/21845ec15b7e4f3fa21b96a84b0225b2 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:37.953134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.048388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.061991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e6a4b-0f28-49b1-82b2-e28a30bbe78f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.076581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96587a72-00ae-42d0-afe3-fd697de68a55 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.099681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.100387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.101022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.101300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.102034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] RBAC: Adding query filter params (role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=481499c89d4842f891010bc0ee49f392) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:38.102345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.103817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.109973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 94/184] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:37 2022] GET /identity/v3/role_assignments?user.id=481499c89d4842f891010bc0ee49f392&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.110842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.136592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d0aae-cf61-4222-b94f-7b76cb72150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.138416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0aae-cf61-4222-b94f-7b76cb72150c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.139208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0aae-cf61-4222-b94f-7b76cb72150c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.139787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0aae-cf61-4222-b94f-7b76cb72150c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.149300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.158529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0aae-cf61-4222-b94f-7b76cb72150c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-212d0aae-cf61-4222-b94f-7b76cb72150c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:38.166867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:38.167883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:38.168692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:38.171747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 91/185] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:38.173467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.174317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.174779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.198122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:38.199593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:38.242141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1cde5-11e4-4e68-a722-9f027705f0d2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.275442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 92/186] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:38.282310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.282962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.283246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.283559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.284603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.284712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.286148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.287888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 95/187] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.288659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.384254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.413378 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22167eb-d84a-4b84-bbfc-c3abf793d1dc None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.424991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.430540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1249cd-99d5-4d1b-9e26-734d71036e73 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.457010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.457841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.458299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.458575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.459298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=21845ec15b7e4f3fa21b96a84b0225b2, user.id=481499c89d4842f891010bc0ee49f392) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:38.460339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.462029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.475725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 93/188] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/role_assignments?user.id=481499c89d4842f891010bc0ee49f392&scope.project.id=21845ec15b7e4f3fa21b96a84b0225b2&role.id=8d82548844954170a8a5017f7a605f61 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.475929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.476039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.476151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.476151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.476151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.491611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:38.498827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:38.499854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:38.500649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 96/189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:38.502083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.595211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e5586-c23b-428e-899c-a1eb046e290f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.631331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dccb2d-2986-4774-80d3-e5409e2bbeb1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.636847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.637388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.637665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.637935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.638614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:38.638916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.640358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.650530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 94/190] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.651287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.656343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.676184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.676820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.677099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.677371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.690383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:38.696249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:38.698386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 97/191] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:38.699174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.730827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.769934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d093b-5271-4ec4-8de4-b4c8836d7f72 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.804327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.804930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.805218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.805490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.806215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=c13c46ea6a164631878622a88f432086) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:38.806525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.808012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.812969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f6fd-b511-4779-be67-b3628fc943dd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.813725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 95/192] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/role_assignments?user.id=c13c46ea6a164631878622a88f432086&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.814505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.853026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.855191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.855191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.855191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.855859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:38.856463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.858767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.872017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 98/193] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.873375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:38.907787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.952530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d66f0-e238-49fe-becf-422762547ae4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.974157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:38.992554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:38.993194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:38.993536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:38.994085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:38.994843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:38.996189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87875b-594b-4ffe-b995-ff7c2d973bb8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:38.996303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:38.998020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 96/194] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:38.998705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.039243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.039929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.040211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.040615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] PATH_INFO: `/v3/users/174cae35d2bc4bf69b518fb08449cf68` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.054977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] RBAC: Authorizing `identity:get_user(user_id=174cae35d2bc4bf69b518fb08449cf68)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.056765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.063609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 99/195] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/users/174cae35d2bc4bf69b518fb08449cf68 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:39.063609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.114682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948770a-5690-4c40-99d8-8f23a986256b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.151955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.152560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.152843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.153118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.153781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:39.154090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.155492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.156861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.170497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dacfe-a698-4504-88e8-ff9f8d631ece None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.170660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 97/196] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:27:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:39.170660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.204097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.204943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.205231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.205578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] PATH_INFO: `/v3/users/4ad678f37d6b40e69bac9858a28de2c9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.206902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad678f37d6b40e69bac9858a28de2c9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.208485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.210119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 100/197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/users/4ad678f37d6b40e69bac9858a28de2c9 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:39.211166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.221966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.269913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074df18-a040-4ebd-9999-f62a6f24ab8f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.304302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.304907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.305190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.305466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.306113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.307590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.311795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93276-3270-44c5-8254-81307a4032f8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.344980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.345573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.345859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.346133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.411044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.412534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.419976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 98/198] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:39 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:39.422225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.432710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.486309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.536806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 101/199] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:39.538265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.539468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f92a-2928-47ec-968f-198be7210cdf None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.581112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.581796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.582119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.582391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] PATH_INFO: `/v3/users/174cae35d2bc4bf69b518fb08449cf68` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.584802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] RBAC: Authorizing `identity:get_user(user_id=174cae35d2bc4bf69b518fb08449cf68)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.587587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.589291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 99/200] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/users/174cae35d2bc4bf69b518fb08449cf68 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:39.594792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.655725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6a035-7422-4032-8d02-6e6c9c3d9106 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.666149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.694110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.695227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.695227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.695442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.723666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1e0ff-dc15-4caa-8b87-cf470eedeeec None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.758249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.770751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.771569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.771866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.774986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:39.774986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.775512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.777346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 100/201] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:39.778067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.797151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:39.798633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:39.910076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffd6f3-eecd-4c52-8c78-07a0f687f5d0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:39.928212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 102/202] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:39.929167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:39.940289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:39.957197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:39.958141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:39.958625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:39.959101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:40.024240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:40.034446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66c8c2-6396-45fb-90e7-27415a2591e9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:40.040168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:40.041898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:40.071534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:40.072134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:40.072419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:40.072699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:40.073437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=174cae35d2bc4bf69b518fb08449cf68) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:40.073751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:40.075257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:40.086071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 103/203] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/role_assignments?user.id=174cae35d2bc4bf69b518fb08449cf68&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:40.086977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:40.182327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 101/204] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:40.187937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:40.213202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:40.251403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04c69-329a-4715-80d5-99c1451eef1b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:40.295033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:40.295708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:40.295992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:40.296275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:40.297409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:40.299475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:40.301168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 104/205] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:40 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:40.308147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:40.375525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:40.389267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937734f-89bd-4a9f-ba4c-b0ee87667d0e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:40.444299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:40.445376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:40.445756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:40.446134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:40.447730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:40.449362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:40.451396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96a1d6-9f06-405e-9464-e5b6d5ee604f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:40.451640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 102/206] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:40 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:40.461621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:40.490463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:40.491053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:40.491334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:40.491636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:40.492498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] RBAC: Adding query filter params (role.id=19202e2098d24e4da79425e52e0a8428, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5, user.id=4ad678f37d6b40e69bac9858a28de2c9) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:40.492809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:40.495088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384f67-2864-4c41-a41c-00ae284b23e5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:40.503498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 105/207] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:40 2022] GET /identity/v3/role_assignments?user.id=4ad678f37d6b40e69bac9858a28de2c9&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=19202e2098d24e4da79425e52e0a8428 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:40.602845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2b41d-de3e-4196-b344-0d5b73fefdcc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:40.641743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:40.642354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:40.642632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:40.642904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:40.643654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] RBAC: Adding query filter params (role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=174cae35d2bc4bf69b518fb08449cf68) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:40.643961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:40.645408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfe84-995e-4887-944d-ab7a65885a76 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:40.652291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 103/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:40 2022] GET /identity/v3/role_assignments?user.id=174cae35d2bc4bf69b518fb08449cf68&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:41.934549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b627a-1c65-4189-880e-77600682f4b1 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:41.935032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b627a-1c65-4189-880e-77600682f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:41.935107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b627a-1c65-4189-880e-77600682f4b1 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:41.936719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 106/209] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:41.941986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:41.942365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:41.942540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:41.962233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:41.963437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:41.978769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:42.026358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ef1e-e0cb-4e4a-ad7c-d3f4b5cdbff6 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.026672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ef1e-e0cb-4e4a-ad7c-d3f4b5cdbff6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.026912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ef1e-e0cb-4e4a-ad7c-d3f4b5cdbff6 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.029102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 107/210] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:42.034073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.034359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.034632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.041294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 104/211] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:42.056473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:42.058015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:42.083743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:42.138173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 108/212] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:42.320426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:42.409515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:42.442314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c746a0-6324-440f-83bb-e4cae77ab34b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:42.482846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:42.483543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.483820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.484145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.495121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:42.499968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:42.500860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:42.503882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 105/213] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:42.508184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:42.528406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:42.541085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135a345-35ec-474a-9840-4c8bfe19a9f3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:42.585272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5be02d-277e-4c68-ab48-a6b0c636e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:42.586100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5be02d-277e-4c68-ab48-a6b0c636e9da None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.586385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5be02d-277e-4c68-ab48-a6b0c636e9da None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.586663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5be02d-277e-4c68-ab48-a6b0c636e9da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.587927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5be02d-277e-4c68-ab48-a6b0c636e9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:42.589510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5be02d-277e-4c68-ab48-a6b0c636e9da None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:42.595604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 109/214] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:42.595604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acdfe2-cb22-4b94-b785-cdbb89b31245 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.595604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acdfe2-cb22-4b94-b785-cdbb89b31245 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.595604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acdfe2-cb22-4b94-b785-cdbb89b31245 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.595604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 110/215] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:42.600518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acdfe2-cb22-4b94-b785-cdbb89b31245 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:42.603566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:42.629093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf763-af23-4c63-83a7-e56940d8b7fe None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:42.664475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:42.665088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.665373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.665648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.666315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:42.666621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:42.668037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a754b-82a6-4669-8a3f-814f8d25f094 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:42.681121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 106/216] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:42.681121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.681121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.681121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.699520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:42.700737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:42.719738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acdfe2-cb22-4b94-b785-cdbb89b31245 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:42.757581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:42.758198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.758475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.758866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.759541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:42.761033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:42.772554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 107/217] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:42.780920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:42.783400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:42.849410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 111/218] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:42 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:42.901803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff125a5-ca3b-44ae-b73f-7d5289f38aa4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:42.941899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b11925-5345-4d35-9abd-30cebcdfbfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:42.942656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11925-5345-4d35-9abd-30cebcdfbfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.943176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11925-5345-4d35-9abd-30cebcdfbfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.943176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11925-5345-4d35-9abd-30cebcdfbfb2 None admin] PATH_INFO: `/v3/users/394cd8beb3234f328d53f376be33d854` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.960366 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b11925-5345-4d35-9abd-30cebcdfbfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=394cd8beb3234f328d53f376be33d854)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:42.962138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b11925-5345-4d35-9abd-30cebcdfbfb2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:42.964407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 108/219] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:42 2022] GET /identity/v3/users/394cd8beb3234f328d53f376be33d854 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:42.973941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:42.979645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b897-3e44-4e9d-9f58-e620629de34a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.979936 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b897-3e44-4e9d-9f58-e620629de34a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.980199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b897-3e44-4e9d-9f58-e620629de34a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:42.981565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 109/220] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:42.987167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:42.987464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:42.987737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.007327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:43.008580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:43.049163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.078540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.103473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 110/221] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:43.103473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.103698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d92f4a-d492-44d0-a711-122f056ddd83 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.141329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.143998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.144307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.144589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.232000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:43.233809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:43.239010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1f98c-71da-4e2b-ba35-94ec74bd4271 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.290126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.290783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.291066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.291344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.309818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:43.313740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:43.314788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:43.315778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:43.316564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:43.317176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 111/222] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:43.323658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.365157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 112/223] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:43.372421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.392555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.457859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076e265-efbc-4c4c-926d-a66b47b80209 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.498242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70aee-db77-4a9b-85bb-4ef3b550da6e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.505678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.507387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.507689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.507964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.508653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:43.509439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:43.511293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:43.522973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 112/224] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:43.523851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.541001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.541648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.541935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.542312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.543615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:43.545054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:43.552063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 113/225] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:43.553026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.587595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.660209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a742-8ab7-4071-a49d-3104a4c982c5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.669089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2046a-1970-47c3-8175-8af1def84f2e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.678966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.708188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.708425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.708832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.709183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.709541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] PATH_INFO: `/v3/users/174cae35d2bc4bf69b518fb08449cf68` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.709967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.710731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.711181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.711351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] RBAC: Authorizing `identity:get_user(user_id=174cae35d2bc4bf69b518fb08449cf68)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:43.713447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:43.715264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 114/226] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/users/174cae35d2bc4bf69b518fb08449cf68 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:43.720161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.727695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:43.733057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:43.733943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:43.734780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 113/227] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:43.735907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.865487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:43.867923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda3012-f097-4e19-a450-3291214b1bfa None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.874175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393faeb5-f98a-4ca0-95de-95dabb211fed None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:43.911325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.912337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.913390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.913690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:43.914054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.914464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:43.914811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:43.915157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:43.915617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=394cd8beb3234f328d53f376be33d854) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:43.916173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:43.916525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:43.918026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:43.918132 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:43.924434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 114/228] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:43.924434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.931464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 115/229] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/role_assignments?user.id=394cd8beb3234f328d53f376be33d854&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=8d82548844954170a8a5017f7a605f61 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:43.937703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:43.982370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:44.058764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b98e7-e07f-4408-a19a-bc5766599108 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:44.100472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:44.102055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:44.102354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:44.102637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:44.103330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:44.103674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:44.105088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:44.114825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 115/230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:27:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:44.121862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:44.200474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91172a6-f825-4cc8-a277-689f1294320c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:44.242546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb8b4a-47c6-4321-abc2-b2d131fd573d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:44.277271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:44.277865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:44.278755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:44.279255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:44.279753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/174cae35d2bc4bf69b518fb08449cf68/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:44.282889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01fa208ad84752903e6cd9c998a073, user_id=174cae35d2bc4bf69b518fb08449cf68, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:44.284827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:44.285674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:44.286312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:44.286596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:44.286875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] PATH_INFO: `/v3/users/174cae35d2bc4bf69b518fb08449cf68` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:44.288170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] RBAC: Authorizing `identity:get_user(user_id=174cae35d2bc4bf69b518fb08449cf68)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:44.290544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:44.295466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 116/231] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:44 2022] GET /identity/v3/users/174cae35d2bc4bf69b518fb08449cf68 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:44.298468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:44.365271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 116/232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:43 2022] PUT /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/174cae35d2bc4bf69b518fb08449cf68/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:44.419884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be295881-cc4b-4cf3-9527-12a40bd1f709 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:44.474612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1501c-d5b0-47b6-9e20-6439ce91a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:44.476089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1501c-d5b0-47b6-9e20-6439ce91a297 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:44.476536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1501c-d5b0-47b6-9e20-6439ce91a297 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:44.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1501c-d5b0-47b6-9e20-6439ce91a297 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:44.481287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1501c-d5b0-47b6-9e20-6439ce91a297 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:44.483740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1501c-d5b0-47b6-9e20-6439ce91a297 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:44.486527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 117/233] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:44 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:44.494311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:44.540758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:44.668152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa864106-e49f-4b94-9e5c-02c316671486 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:44.712888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a92500-dcb7-4ccc-8fd3-d11f06d6c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:44.713931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a92500-dcb7-4ccc-8fd3-d11f06d6c6f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:44.714431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a92500-dcb7-4ccc-8fd3-d11f06d6c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:44.714909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a92500-dcb7-4ccc-8fd3-d11f06d6c6f8 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/174cae35d2bc4bf69b518fb08449cf68/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:44.717401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a92500-dcb7-4ccc-8fd3-d11f06d6c6f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01fa208ad84752903e6cd9c998a073, user_id=174cae35d2bc4bf69b518fb08449cf68, role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:44.719080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a92500-dcb7-4ccc-8fd3-d11f06d6c6f8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:44.864111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 117/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:44 2022] PUT /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/174cae35d2bc4bf69b518fb08449cf68/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:45.467218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15c090-9623-421b-92be-f36072d34ba4 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:45.467763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15c090-9623-421b-92be-f36072d34ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:45.467868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15c090-9623-421b-92be-f36072d34ba4 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:45.469484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 118/235] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:45.475147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596611-3dbd-439b-85bb-83984c8daa27 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:45.475842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596611-3dbd-439b-85bb-83984c8daa27 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:45.475842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596611-3dbd-439b-85bb-83984c8daa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:45.494948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9b596611-3dbd-439b-85bb-83984c8daa27 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:45.496186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9b596611-3dbd-439b-85bb-83984c8daa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:45.568222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 118/236] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:45.608443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4602-899e-412f-a7ef-40707add6877 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:45.608749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4602-899e-412f-a7ef-40707add6877 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:45.608992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4602-899e-412f-a7ef-40707add6877 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:45.610619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 119/237] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:45.616117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:45.616416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:45.616684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:45.644512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:45.645749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:45.648766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:45.731646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 119/238] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:45.988545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb4602-899e-412f-a7ef-40707add6877 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:46.046160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:46.077610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:46.163109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb4602-899e-412f-a7ef-40707add6877 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:46.236168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:46.236805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.237085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.237356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.257255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8263e5-2c93-474a-add4-f5cd516eccfc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:46.261333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:46.267504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:46.268396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:46.269184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 120/239] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:46.279406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:46.328067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:46.328706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.328984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.329258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.331125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:46.333233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:46.335830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 120/240] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:46.341698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:46.358247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:46.485420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:46.489213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67635a-36ac-4828-a5a6-7a326ac61c17 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:46.514415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce60b6-79cd-4817-84a5-3a657947a6d7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:46.550160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:46.551039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.551506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.551921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.552707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:46.555014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:46.579328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:46.580388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.580818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.581277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.582091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:46.582540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:46.584551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:46.594755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 121/241] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:46.603353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:46.630907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 121/242] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:46 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:46.736570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00176a1-8860-4182-9754-25a368d80505 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:46.777110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e53e84-d24b-455e-a124-2442908568ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:46.777995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53e84-d24b-455e-a124-2442908568ab None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.778466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53e84-d24b-455e-a124-2442908568ab None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.778904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e53e84-d24b-455e-a124-2442908568ab None admin] PATH_INFO: `/v3/users/8b6ca83da4634b84bcc3c1a48b8da72e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.795857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e53e84-d24b-455e-a124-2442908568ab None admin] RBAC: Authorizing `identity:get_user(user_id=8b6ca83da4634b84bcc3c1a48b8da72e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:46.797658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e53e84-d24b-455e-a124-2442908568ab None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:46.799955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 122/243] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:46 2022] GET /identity/v3/users/8b6ca83da4634b84bcc3c1a48b8da72e => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:46.806071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:46.843866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92c47-541a-47c7-b355-e1fd6d7cf1fa None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.844433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92c47-541a-47c7-b355-e1fd6d7cf1fa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.844921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92c47-541a-47c7-b355-e1fd6d7cf1fa None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.846532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 123/244] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:46.857037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d156c9-b701-4cbc-b599-423645129306 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:46.857550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d156c9-b701-4cbc-b599-423645129306 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:46.857969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d156c9-b701-4cbc-b599-423645129306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:46.889024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a8d156c9-b701-4cbc-b599-423645129306 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:46.892562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a8d156c9-b701-4cbc-b599-423645129306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:46.916269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:46.920884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:46.979204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf360-50ed-4eb7-aa84-b536a90faea3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:47.009832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 124/245] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:47.030123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:47.031145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.032581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.033066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.103893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29004ff-7a81-4d23-9253-66c22db3b226 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.104179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29004ff-7a81-4d23-9253-66c22db3b226 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.104456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29004ff-7a81-4d23-9253-66c22db3b226 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.106194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 125/246] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:47.109282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:47.111327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.111570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:47.111670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.111925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.153683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:47.154897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:47.179953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:47.233416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 122/247] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:47.238787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:47.260639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 126/248] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:47.351605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:47.355231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be5a32-71e7-4983-aecc-d4ef40baea5a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:47.397816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:47.399077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.399794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.400217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.402050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:47.404348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:47.407642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 123/249] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:47.416471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:47.464284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:47.469534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:47.493254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4183a7-e531-441c-aaff-3da965004736 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:47.531746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:47.532785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.533339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.534141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.546768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:47.551334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c1f3-219a-44a0-9244-a030318ab4f2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:47.551990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:47.553202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:47.554200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:47.554932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 127/250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:47.562178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:47.601070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:47.602938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.604678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.605381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.606587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] RBAC: Adding query filter params (role.id=19202e2098d24e4da79425e52e0a8428, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=8b6ca83da4634b84bcc3c1a48b8da72e) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:47.607912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:47.611589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:47.623281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 124/251] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/role_assignments?user.id=8b6ca83da4634b84bcc3c1a48b8da72e&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=19202e2098d24e4da79425e52e0a8428 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:47.679653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:47.725616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d38f5-e9e9-4a5a-8d9e-a26061afa1cf None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:47.782471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:47.783985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.795434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.795434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.795434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:47.795434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:47.795434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:47.805273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:47.813944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 128/252] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:47.820538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:47.827400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:47.838506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1f679-86da-43fd-905b-b1a8aed09632 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:47.904728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03969b1-0c7b-4b27-9d57-6154dde47b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:47.905805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03969b1-0c7b-4b27-9d57-6154dde47b97 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.906290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03969b1-0c7b-4b27-9d57-6154dde47b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.906740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03969b1-0c7b-4b27-9d57-6154dde47b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.935004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03969b1-0c7b-4b27-9d57-6154dde47b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f03969b1-0c7b-4b27-9d57-6154dde47b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:47.940853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:47.941743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:27:47.942573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:47.949304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 125/253] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:47.951571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee1b91-325a-4732-a3e6-1604809c9479 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:47.952060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee1b91-325a-4732-a3e6-1604809c9479 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:47.954025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee1b91-325a-4732-a3e6-1604809c9479 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:47.956382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 126/254] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:47.957386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee1b91-325a-4732-a3e6-1604809c9479 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:48.043141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face008a-ca72-4ec3-bf2b-62fb7129abf7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:48.080274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1d70-1131-40bc-a32d-be0839591006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:48.081250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1d70-1131-40bc-a32d-be0839591006 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.081727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1d70-1131-40bc-a32d-be0839591006 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.082243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1d70-1131-40bc-a32d-be0839591006 None admin] PATH_INFO: `/v3/users/394cd8beb3234f328d53f376be33d854` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.083674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1d70-1131-40bc-a32d-be0839591006 None admin] RBAC: Authorizing `identity:get_user(user_id=394cd8beb3234f328d53f376be33d854)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:48.085682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1d70-1131-40bc-a32d-be0839591006 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:48.087845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 129/255] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/users/394cd8beb3234f328d53f376be33d854 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:48.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.089757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.090271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.110136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:48.111665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:48.180289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:48.186609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 130/256] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:48.187796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:48.224644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee1b91-325a-4732-a3e6-1604809c9479 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:48.296343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc0fc1-025f-4d6e-af8d-788c2138e92b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:48.296668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:48.297273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.297574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.297830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.298511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:48.298821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:48.300234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:48.315050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 127/257] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:48.321399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:48.354500 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:48.355154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.355465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.355745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.357015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:48.359718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:48.359917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:48.366283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 131/258] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:48 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:48.368844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:48.467946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:48.530090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e6a2c-8a2b-43b8-8407-aaa7db088225 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:48.544775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718011a-1373-4d85-b9e4-7ca0464f15d8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:48.601890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:48.605111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.605662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.606119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/394cd8beb3234f328d53f376be33d854/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.611095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01fa208ad84752903e6cd9c998a073, user_id=394cd8beb3234f328d53f376be33d854, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:48.613439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:48.620975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:48.622286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.622797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.623254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] PATH_INFO: `/v3/users/174cae35d2bc4bf69b518fb08449cf68` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.625149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] RBAC: Authorizing `identity:get_user(user_id=174cae35d2bc4bf69b518fb08449cf68)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:48.626769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:48.628943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 128/259] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:48 2022] GET /identity/v3/users/174cae35d2bc4bf69b518fb08449cf68 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:48.636245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:48.719008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 132/260] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:48 2022] PUT /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/394cd8beb3234f328d53f376be33d854/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:27:48.741527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:48.759918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48de379-4b36-49ba-a8c3-486f3c84b09d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:48.776315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:48.807110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:48.808059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:48.808526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:48.810127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:48.966085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:48.968408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:48.980658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2cb40-35d2-498a-bca6-379aa723fdbf None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:49.034129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:49.056224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:49.056892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.057177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.057452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.082445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:49.092854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:49.100486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:27:49.101300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 133/261] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:27:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:49.104511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:49.151335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:49.178105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 129/262] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 14:27:49.186279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:49.317894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a63d-691b-450a-90e2-0426c594e694 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:49.351988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fcdb7-67fd-4a26-850a-c383cf46e759 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:49.387011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:49.387691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.387978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.388259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.389405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:49.390963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:49.393239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:49.393897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.394182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.394456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.395126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:49.395486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 130/263] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:49 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:49.399518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:49.400958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:49.405871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:49.412147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 134/264] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:49.420935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:49.464438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:49.506045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:49.515877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2109-a9a3-4383-a0a4-b01e5e66b4ed None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:49.553636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:49.554586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.554971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.555402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.556261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=174cae35d2bc4bf69b518fb08449cf68) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:49.556672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:49.558287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:49.564935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 131/265] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:49 2022] GET /identity/v3/role_assignments?user.id=174cae35d2bc4bf69b518fb08449cf68&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:49.584868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a75d4-05bf-4622-a438-20dd311c640b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:49.631888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efadee0-b975-4770-a55e-93e620a91f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:49.632606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadee0-b975-4770-a55e-93e620a91f66 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.632882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadee0-b975-4770-a55e-93e620a91f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.633157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efadee0-b975-4770-a55e-93e620a91f66 None admin] PATH_INFO: `/v3/users/174cae35d2bc4bf69b518fb08449cf68` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.634427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efadee0-b975-4770-a55e-93e620a91f66 None admin] RBAC: Authorizing `identity:get_user(user_id=174cae35d2bc4bf69b518fb08449cf68)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:49.636026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efadee0-b975-4770-a55e-93e620a91f66 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:49.638072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 135/266] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:49 2022] GET /identity/v3/users/174cae35d2bc4bf69b518fb08449cf68 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:49.643470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:49.781387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a4ac-6ac3-4dfb-b00a-b291323e0322 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:49.802055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:49.821969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:49.822673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.822963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.823239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.906360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:49.907969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:49.980535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742eec6-d9a9-4e80-8019-e852786639ed None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:49.980886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742eec6-d9a9-4e80-8019-e852786639ed None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:49.981080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742eec6-d9a9-4e80-8019-e852786639ed None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:49.982604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 136/267] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:50.001888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.001888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.001888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.018258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 132/268] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:50.024366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:50.044625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:50.045827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:50.056580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:50.195324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b6e8b-efac-48dd-853e-80f0ed63b866 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:50.201471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 137/269] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:50.239190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e87f2b-ccf1-46ee-a27a-0575f60791a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:50.240424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87f2b-ccf1-46ee-a27a-0575f60791a4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.240931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87f2b-ccf1-46ee-a27a-0575f60791a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.241336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e87f2b-ccf1-46ee-a27a-0575f60791a4 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.242576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e87f2b-ccf1-46ee-a27a-0575f60791a4 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:50.244144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e87f2b-ccf1-46ee-a27a-0575f60791a4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:50.247308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 133/270] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:50 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:50.251641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:50.319449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:50.385022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1046e-11cf-4dd1-a001-b684fcb09a61 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:50.434093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:50.434719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.435003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.435275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.436044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] RBAC: Adding query filter params (role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=174cae35d2bc4bf69b518fb08449cf68) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:50.436356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:50.437801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041ca4-2e9f-44fa-bfe0-80c3d2036326 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:50.448478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 138/271] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:50 2022] GET /identity/v3/role_assignments?user.id=174cae35d2bc4bf69b518fb08449cf68&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:50.476828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eab31a-1bd3-4d04-8910-fecffb7dc428 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.477172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eab31a-1bd3-4d04-8910-fecffb7dc428 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.477392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eab31a-1bd3-4d04-8910-fecffb7dc428 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.478775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 134/272] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:50.484929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.485233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.485479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.505076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:50.506962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:50.592334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eab31a-1bd3-4d04-8910-fecffb7dc428 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:50.609292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 139/273] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:50.700183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:50.725672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eab31a-1bd3-4d04-8910-fecffb7dc428 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:50.765001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:50.765650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.765989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.766275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.778214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:50.783414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:50.785495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:50.787807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 135/274] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:50.792484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:50.851803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:50.940652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985f25c-15bd-4157-b9ff-4863d18c88a4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:50.961172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:50.989614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:50.990370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:50.990657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:50.990931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:50.991807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:50.992112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:50.993587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6fc7f-2944-409b-b2cb-29071d2e5792 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:51.002539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 140/275] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:51.003865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdcda-5033-4c82-bf01-e31e26842e1b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.004153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdcda-5033-4c82-bf01-e31e26842e1b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.004433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfdcda-5033-4c82-bf01-e31e26842e1b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.005776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 141/276] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:51.010185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfdcda-5033-4c82-bf01-e31e26842e1b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:51.085099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0afc0a-5370-4583-8f8c-036469ce449c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:51.121393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2611e51-385f-42ab-a606-033a8c8ae020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:51.122048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2611e51-385f-42ab-a606-033a8c8ae020 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.122311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2611e51-385f-42ab-a606-033a8c8ae020 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.122587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2611e51-385f-42ab-a606-033a8c8ae020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.123304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfdcda-5033-4c82-bf01-e31e26842e1b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:51.123713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2611e51-385f-42ab-a606-033a8c8ae020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:51.125033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:51.125210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2611e51-385f-42ab-a606-033a8c8ae020 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:51.127040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 136/277] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:51.133645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.133937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.134215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.152733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:51.154004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:51.160291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:51.160929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.161214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.161531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:51.162974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] PATH_INFO: `/v3/users/31153aecc7eb41878048e4c433712d8a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.176268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=31153aecc7eb41878048e4c433712d8a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:51.177722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:51.180309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 142/278] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:51 2022] GET /identity/v3/users/31153aecc7eb41878048e4c433712d8a => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:51.185917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:51.231603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 137/279] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:51.231603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:51.304456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512186-d39a-4047-9b40-1027a8ee2ea0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:51.342129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:51.343126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.343709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.344196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.345041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:51.346710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:51.372461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8db996-2a95-4247-a0f1-f91e1d3b086b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:51.410756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:51.411641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.411925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.412754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.413687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, user.id=31153aecc7eb41878048e4c433712d8a, scope.system=all) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:51.414002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:51.415583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:51.421040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 138/280] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Sep 7 14:27:51 2022] GET /identity/v3/role_assignments?user.id=31153aecc7eb41878048e4c433712d8a&scope.system=all&role.id=8d82548844954170a8a5017f7a605f61 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:51.441829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 143/281] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:27:51 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:51.520969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:51.532469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:51.649502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3c0f5-ca71-4813-9993-95086a565803 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:51.689206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:51.689851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.690135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.690412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.703003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:51.712632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:51.716642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:51.717664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 139/282] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:51.719657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:51.744991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:51.847490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b96623-1354-4214-b66b-9b752a4be811 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:51.886551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:51.887640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.888157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.888656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.889765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:51.890081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:51.891503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891f20b-b2ee-40bd-a0de-fb06c01ea97a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:51.902070 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 144/283] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:51.907865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:51.967301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603afa3-7de4-4d92-bd89-76f40d087e0b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.967638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603afa3-7de4-4d92-bd89-76f40d087e0b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.967888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603afa3-7de4-4d92-bd89-76f40d087e0b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.969257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 145/284] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:51.977394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:51.977394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:51.977394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:51.987158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:52.001209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:52.003495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:52.026593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0474c7-26f4-416c-ab19-7e7afdb01f2d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:52.065952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:52.066696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:52.067054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:52.067423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] PATH_INFO: `/v3/users/8b6ca83da4634b84bcc3c1a48b8da72e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:52.069324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] RBAC: Authorizing `identity:get_user(user_id=8b6ca83da4634b84bcc3c1a48b8da72e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:52.071059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:52.077445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 140/285] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:51 2022] GET /identity/v3/users/8b6ca83da4634b84bcc3c1a48b8da72e => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:52.079413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:52.139263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 146/286] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:52.204860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723605-dd12-49a0-9b0f-d64b2c56ec68 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:52.242566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:52.243603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:52.244095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:52.244573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:52.245931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:52.247627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:52.254392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 141/287] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:52 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:52.257074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:52.286900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:52.406071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd374b8-49dc-4a93-a7bd-ee3fb141d3d2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:52.447103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:52.448161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:52.448649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:52.449128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/8b6ca83da4634b84bcc3c1a48b8da72e/roles/19202e2098d24e4da79425e52e0a8428` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:52.451274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01fa208ad84752903e6cd9c998a073, user_id=8b6ca83da4634b84bcc3c1a48b8da72e, role_id=19202e2098d24e4da79425e52e0a8428)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:52.453023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:52.501504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:52.504706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:52.528590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 147/288] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:27:52 2022] PUT /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073/users/8b6ca83da4634b84bcc3c1a48b8da72e/roles/19202e2098d24e4da79425e52e0a8428 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:27:52.635344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f223-e150-4160-8397-4d5285628a41 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:52.685660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:52.686308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:52.686642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:52.686924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:52.700617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:52.706014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:52.707358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:52.708927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 142/289] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:52.714388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:52.792611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:52.827740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee01b-3043-4827-8863-2293b6b80c89 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:52.866536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:52.867163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:52.867481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:52.867761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:52.868511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:52.868822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:52.870236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:52.879948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 148/290] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:52.886555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:52.967016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:53.009718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c559c-6d25-4c47-b5e7-a1221c7c0f86 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:53.051992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:53.053455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:53.053910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:53.054353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] PATH_INFO: `/v3/users/394cd8beb3234f328d53f376be33d854` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:53.055745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] RBAC: Authorizing `identity:get_user(user_id=394cd8beb3234f328d53f376be33d854)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:53.057527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:53.059281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 143/291] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:52 2022] GET /identity/v3/users/394cd8beb3234f328d53f376be33d854 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:53.065000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:53.174753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bc16c-adce-4509-8a80-44e066958811 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:53.205690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:53.213228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:53.214136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:53.214595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:53.215068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:53.285171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:53.286973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:53.393849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 149/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:53.400374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:53.551683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcdfcf-4812-473f-bff5-d679ee02b02f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:53.592351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:53.601964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e1838-f795-460d-8e44-7ab7609c0dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:53.602690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e1838-f795-460d-8e44-7ab7609c0dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:53.602987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e1838-f795-460d-8e44-7ab7609c0dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:53.603266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e1838-f795-460d-8e44-7ab7609c0dc6 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:53.604472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e1838-f795-460d-8e44-7ab7609c0dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:53.609769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e1838-f795-460d-8e44-7ab7609c0dc6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:53.609769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 144/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:53 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:53.613740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:53.662606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:53.749573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c40a-e312-49ae-bc9d-88afe4a9703a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:53.786064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:53.786679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:53.786958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:53.787889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:53.788591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=394cd8beb3234f328d53f376be33d854) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:53.788897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:53.790336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a2ff4-7cfe-4383-9c89-ec9ff91625d8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:53.796879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 150/294] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:53 2022] GET /identity/v3/role_assignments?user.id=394cd8beb3234f328d53f376be33d854&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=8d82548844954170a8a5017f7a605f61 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:54.170646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc740b-f9bd-4f3a-8b48-311a84c2a113 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.171629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc740b-f9bd-4f3a-8b48-311a84c2a113 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.172153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc740b-f9bd-4f3a-8b48-311a84c2a113 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.173966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 145/295] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:54.182402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d97a-16b8-4e78-9455-86a225e6c685 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.182664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d97a-16b8-4e78-9455-86a225e6c685 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.182891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d97a-16b8-4e78-9455-86a225e6c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.208554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ac16d97a-16b8-4e78-9455-86a225e6c685 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:54.210719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ac16d97a-16b8-4e78-9455-86a225e6c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:54.300319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 151/296] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:54.382628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf35af-723b-4dfe-9474-ec6b47db38d1 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.382954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf35af-723b-4dfe-9474-ec6b47db38d1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.383199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf35af-723b-4dfe-9474-ec6b47db38d1 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.384732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 146/297] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:54.391410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df16a49-df76-4101-904e-d27410ba7837 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.391410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df16a49-df76-4101-904e-d27410ba7837 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.391410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df16a49-df76-4101-904e-d27410ba7837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.416228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3df16a49-df76-4101-904e-d27410ba7837 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:54.417796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3df16a49-df76-4101-904e-d27410ba7837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:54.440985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:54.499510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 152/298] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:54.596590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf35af-723b-4dfe-9474-ec6b47db38d1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:54.674457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea582b-96f8-450b-a9d1-54a8bdfd896b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.675105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea582b-96f8-450b-a9d1-54a8bdfd896b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.675620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea582b-96f8-450b-a9d1-54a8bdfd896b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.677462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 153/299] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:54.682975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.683507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.683995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.703881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:54.705173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:54.706828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf35af-723b-4dfe-9474-ec6b47db38d1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:54.745982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:54.746940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.747366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.747871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.759443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:54.764559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:54.765683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:54.766695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:54.769043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 147/300] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:54.775304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:54.791504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 154/301] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:54.808812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:54.848590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:54.889762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658769f7-98b9-4b74-988d-9807b7f2f8bb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:54.899796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:54.916584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d9898-6f5b-458a-9fc7-5369abecc0b4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:54.926430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:54.927351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.927974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.928451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.929377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:54.929875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:54.931465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:54.940723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 148/302] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:54.946894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:54.964544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:54.965167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:54.965449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:54.965720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:54.967168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:54.968981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:54.975450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 155/303] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:54.977633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:55.079828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2a37-f8fd-422c-8cec-a1f7841db669 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.088143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde62a7d-0580-4fc4-821f-dbdb1df9512a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.106878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:55.122211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.122962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.123178 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.123509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] PATH_INFO: `/v3/users/31153aecc7eb41878048e4c433712d8a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.124610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] RBAC: Authorizing `identity:get_user(user_id=31153aecc7eb41878048e4c433712d8a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:55.126049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:55.126655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.127478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.132946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.133082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 149/304] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:54 2022] GET /identity/v3/users/31153aecc7eb41878048e4c433712d8a => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:55.133159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] PATH_INFO: `/v3/groups` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.133159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:55.133395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:55.133465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:55.229810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 156/305] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Sep 7 14:27:54 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:27:55.230550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:55.248543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131de25-d2b6-4b23-a9a3-866ced8c250c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.259776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:55.300722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.301402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.301691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.301970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.319184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:55.326454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:55.327932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:55.328840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 150/306] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:55.333763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:55.383166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49790fb-c296-4abf-86f1-e164956fff93 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.391860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:55.428557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf685d68-717d-43bb-8377-23a17c0a6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.429821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf685d68-717d-43bb-8377-23a17c0a6b43 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.429821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf685d68-717d-43bb-8377-23a17c0a6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.430020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf685d68-717d-43bb-8377-23a17c0a6b43 None admin] PATH_INFO: `/v3/system/users/31153aecc7eb41878048e4c433712d8a/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.431583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf685d68-717d-43bb-8377-23a17c0a6b43 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=31153aecc7eb41878048e4c433712d8a, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:55.432970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf685d68-717d-43bb-8377-23a17c0a6b43 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:55.457064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecef0f-8a5a-4be1-aa88-8b4755412599 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.492166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.492704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.492987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.493264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.493928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:55.494235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:55.495638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b387-ced4-47ca-996a-636c80405393 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:55.503748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 151/307] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:55.504911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5c12-89d7-4873-96e8-63509d7b2ee8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.505199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5c12-89d7-4873-96e8-63509d7b2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.505471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5c12-89d7-4873-96e8-63509d7b2ee8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.507551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 152/308] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:55.510421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e5c12-89d7-4873-96e8-63509d7b2ee8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:55.515319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 157/309] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Sep 7 14:27:55 2022] PUT /identity/v3/system/users/31153aecc7eb41878048e4c433712d8a/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:27:55.516516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.516800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.517072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.549618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:55.551735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:55.646559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e5c12-89d7-4873-96e8-63509d7b2ee8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.656619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 158/310] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:55.666971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:55.694152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.694929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.695281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.695662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] PATH_INFO: `/v3/users/2bfd72a521d940d29494c4425c24be3e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.710997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] RBAC: Authorizing `identity:get_user(user_id=2bfd72a521d940d29494c4425c24be3e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:55.713963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:55.715990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 153/311] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:55 2022] GET /identity/v3/users/2bfd72a521d940d29494c4425c24be3e => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:55.722150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:55.732462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:55.836755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e6806-bb96-45be-b648-ee0ebecf5ef1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:55.873247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:55.873865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:55.874146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:55.874421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:55.875153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] RBAC: Adding query filter params (role.id=19202e2098d24e4da79425e52e0a8428, user.id=2bfd72a521d940d29494c4425c24be3e, scope.system=all) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:55.875491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:55.876939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:55.883064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 159/312] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Sep 7 14:27:55 2022] GET /identity/v3/role_assignments?user.id=2bfd72a521d940d29494c4425c24be3e&scope.system=all&role.id=19202e2098d24e4da79425e52e0a8428 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:55.938087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:56.076705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522163-e88f-4cb9-83c0-222fa1cff238 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:56.338205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:56.338205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:56.338205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:56.338205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:56.338988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:56.339768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:56.340663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 154/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:27:56.341466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:56.341466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:56.341466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee9062-494c-4bb0-9477-8cd9882948c9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:56.341466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:56.341740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:56.341740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:56.341740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:56.341740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:56.341740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:56.341740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:56.342106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 160/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:56.342177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:56.342177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:56.411202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f915d0-1d23-4cae-8a7e-4471c38390c7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:56.447261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:56.447938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:56.448222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:56.448500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] PATH_INFO: `/v3/users/8b6ca83da4634b84bcc3c1a48b8da72e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:56.449632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] RBAC: Authorizing `identity:get_user(user_id=8b6ca83da4634b84bcc3c1a48b8da72e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:56.451053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:56.452969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 155/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:56 2022] GET /identity/v3/users/8b6ca83da4634b84bcc3c1a48b8da72e => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:56.458567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:56.567434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28391-8a4d-4206-935f-6a216d777f9e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:56.603124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:56.606895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:56.607819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:56.608319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:56.608793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:56.685435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:56.686913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:56.792685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 161/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:27:56.797874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:56.899631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:56.905299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb4a54-262e-4283-ad76-f84f79791c05 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:56.940666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f2f6-87c4-40ac-a19b-8846e33a0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:56.941306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f2f6-87c4-40ac-a19b-8846e33a0811 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:56.941596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f2f6-87c4-40ac-a19b-8846e33a0811 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:56.941879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f2f6-87c4-40ac-a19b-8846e33a0811 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:56.943017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f2f6-87c4-40ac-a19b-8846e33a0811 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:56.944829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f2f6-87c4-40ac-a19b-8846e33a0811 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:56.946661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 156/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:27:56 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:56.952459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:56.985380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:57.060330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a460c58-425c-4927-b2ea-a5dceb0bbffb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:57.095997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:57.096608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:57.096891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:57.097166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:57.097897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] RBAC: Adding query filter params (role.id=19202e2098d24e4da79425e52e0a8428, scope.project.id=cd01fa208ad84752903e6cd9c998a073, user.id=8b6ca83da4634b84bcc3c1a48b8da72e) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:57.098208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:57.100315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c8f08-c00e-4c53-b060-fa2dc4ca1890 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:57.106487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 162/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:27:56 2022] GET /identity/v3/role_assignments?user.id=8b6ca83da4634b84bcc3c1a48b8da72e&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=19202e2098d24e4da79425e52e0a8428 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:57.582118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4f1a-5a32-46c5-8a15-4f205f7f1fa0 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:57.582666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4f1a-5a32-46c5-8a15-4f205f7f1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:57.582666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4f1a-5a32-46c5-8a15-4f205f7f1fa0 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:57.584848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 157/319] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:57.590386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ceb9-7b72-4308-ad35-98593461ac49 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:57.590675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ceb9-7b72-4308-ad35-98593461ac49 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:57.590944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ceb9-7b72-4308-ad35-98593461ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:57.608922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e957ceb9-7b72-4308-ad35-98593461ac49 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:57.610097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e957ceb9-7b72-4308-ad35-98593461ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:57.679908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 163/320] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:57.907425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ecb4-730c-4d67-974d-7849461c9c11 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:57.907609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ecb4-730c-4d67-974d-7849461c9c11 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:57.907895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ecb4-730c-4d67-974d-7849461c9c11 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:57.909354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 158/321] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:27:57.915594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:57.915879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:57.916155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:57.938368 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:57.939572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:57.957517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ecb4-730c-4d67-974d-7849461c9c11 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:57.963769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:58.013328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 164/322] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:27:58.067983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ecb4-730c-4d67-974d-7849461c9c11 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.107315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e098-6c5c-4562-a0dd-9f1567a91781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.107956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e098-6c5c-4562-a0dd-9f1567a91781 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.108342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e098-6c5c-4562-a0dd-9f1567a91781 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.108658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e098-6c5c-4562-a0dd-9f1567a91781 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.109778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e098-6c5c-4562-a0dd-9f1567a91781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:58.111215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e098-6c5c-4562-a0dd-9f1567a91781 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:58.115499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 159/323] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:58.118432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.190326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39930-9a3e-4ed8-af0c-7a7c0bd555e3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.190620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39930-9a3e-4ed8-af0c-7a7c0bd555e3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.190817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39930-9a3e-4ed8-af0c-7a7c0bd555e3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.192194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 160/324] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:27:58.197768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.198061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.198341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.217297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:27:58.218491 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:27:58.224733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1ca8-9ae9-482e-b2ed-633043a34c7b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.248649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:58.264395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.265021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.265301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.265928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] PATH_INFO: `/v3/groups` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.266598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:58.268778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:58.292545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 161/325] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:27:58.301256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.376903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 165/326] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Sep 7 14:27:58 2022] POST /identity/v3/groups => generated 226 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:27:58.404451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef30c-c5f4-4954-bc35-4bcdfdf060a0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.442955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.443563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.443841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.444119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.455825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:58.461664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:58.462623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:58.464391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 162/327] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:58.468787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.491011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:58.561736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.589226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194898-56a0-4a9a-abcf-c77230431f3e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.591467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:58.630549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.631845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.632468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.632759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.633450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:58.634327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:58.635793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:58.650192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 166/328] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:58.651356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.692773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccd9e-3754-4975-9b8c-18d0195a186d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.745663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684522-e659-4078-863b-32901d575bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.746235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684522-e659-4078-863b-32901d575bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.746520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684522-e659-4078-863b-32901d575bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.746798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de684522-e659-4078-863b-32901d575bb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.753809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:58.761681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de684522-e659-4078-863b-32901d575bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-de684522-e659-4078-863b-32901d575bb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:27:58.768924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:27:58.769849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:27:58.770682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 163/329] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:27:58.776719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684522-e659-4078-863b-32901d575bb1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.786314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8113-73cc-4301-868c-224c25587ab5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.828756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.829404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.829682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.829954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] PATH_INFO: `/v3/users/31153aecc7eb41878048e4c433712d8a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.831092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] RBAC: Authorizing `identity:get_user(user_id=31153aecc7eb41878048e4c433712d8a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:58.833669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:58.839487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 167/330] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/users/31153aecc7eb41878048e4c433712d8a => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:27:58.841747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.895743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:58.905563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de684522-e659-4078-863b-32901d575bb1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:58.943576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:58.944241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:58.944528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:58.944799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:58.945473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:58.945778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:58.947159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:58.957329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 164/331] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:58.964092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:58.970891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a77d49-cdd6-4083-8a2f-e6dd9b08b78d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:59.009749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:59.010538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:59.010826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:59.011102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:59.011880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] RBAC: Adding query filter params (role.id=8d82548844954170a8a5017f7a605f61, user.id=31153aecc7eb41878048e4c433712d8a, scope.system=all) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:27:59.012197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:59.013653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:59.029804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 168/332] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/role_assignments?user.id=31153aecc7eb41878048e4c433712d8a&scope.system=all&role.id=8d82548844954170a8a5017f7a605f61 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:59.094880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaabd05-6277-4fb2-bfce-05cd07ca11b3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:59.142900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da1df-1c5f-4668-9652-8bc3f5a80d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:59.143640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da1df-1c5f-4668-9652-8bc3f5a80d5e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:59.143928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da1df-1c5f-4668-9652-8bc3f5a80d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:59.144206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da1df-1c5f-4668-9652-8bc3f5a80d5e None admin] PATH_INFO: `/v3/users/2bfd72a521d940d29494c4425c24be3e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:59.145401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da1df-1c5f-4668-9652-8bc3f5a80d5e None admin] RBAC: Authorizing `identity:get_user(user_id=2bfd72a521d940d29494c4425c24be3e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:59.147440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da1df-1c5f-4668-9652-8bc3f5a80d5e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:59.149186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 165/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:27:58 2022] GET /identity/v3/users/2bfd72a521d940d29494c4425c24be3e => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:27:59.155471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:27:59.163253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:27:59.329577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c4f3-16c6-4f08-9c32-b63f6cbf4e11 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:27:59.367931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd19b-2a4e-4de7-abee-61e0f28d3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:27:59.368608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd19b-2a4e-4de7-abee-61e0f28d3a0f None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:27:59.368891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd19b-2a4e-4de7-abee-61e0f28d3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:27:59.369177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd19b-2a4e-4de7-abee-61e0f28d3a0f None admin] PATH_INFO: `/v3/system/users/2bfd72a521d940d29494c4425c24be3e/roles/19202e2098d24e4da79425e52e0a8428` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:27:59.371548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd19b-2a4e-4de7-abee-61e0f28d3a0f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2bfd72a521d940d29494c4425c24be3e, role_id=19202e2098d24e4da79425e52e0a8428)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:27:59.372950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd19b-2a4e-4de7-abee-61e0f28d3a0f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:27:59.471669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 169/334] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Sep 7 14:27:59 2022] PUT /identity/v3/system/users/2bfd72a521d940d29494c4425c24be3e/roles/19202e2098d24e4da79425e52e0a8428 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:00.950588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf43d2-5b2a-4b07-87aa-7af5408e3ce8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:00.951598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf43d2-5b2a-4b07-87aa-7af5408e3ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:00.952079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf43d2-5b2a-4b07-87aa-7af5408e3ce8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:00.953654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 166/335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:00.959433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b45fba-5920-4924-acf0-25287ca47d3b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:00.959943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b45fba-5920-4924-acf0-25287ca47d3b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:00.960198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b45fba-5920-4924-acf0-25287ca47d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:00.989016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-24b45fba-5920-4924-acf0-25287ca47d3b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:00.990780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-24b45fba-5920-4924-acf0-25287ca47d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:01.077770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:01.084114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 170/336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:01.556157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b67d61-5c3a-4c16-a29d-7473c6ad412f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:01.556561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b67d61-5c3a-4c16-a29d-7473c6ad412f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:01.556755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b67d61-5c3a-4c16-a29d-7473c6ad412f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:01.558343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 167/337] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:01.563549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:01.563841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:01.564116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:01.586518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:01.587776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:01.669984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b67d61-5c3a-4c16-a29d-7473c6ad412f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:01.671028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 171/338] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:01.697793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:01.823485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b67d61-5c3a-4c16-a29d-7473c6ad412f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:01.872781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:01.874896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:01.874896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:01.874896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:01.892230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:01.897793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:01.898682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:01.899520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:01.903483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 168/339] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:01.907769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:02.141370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd556fb-ae7e-47fa-856b-6d4402d2b583 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:02.179257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:02.187234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:02.191564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:02.191564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:02.191564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:02.191564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:02.191564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:02.191564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:02.203632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 172/340] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:02.210241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:02.245912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:02.326822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:02.358030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b0a6-3967-41f0-b220-5cbc05676e5d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:02.408669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:02.410634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:02.411125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:02.412325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:02.438535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a5933-5eb6-4d02-bb16-ef4b3bac521c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:02.496918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbedc2-e053-4dd0-837b-452ad5399f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:02.497567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbedc2-e053-4dd0-837b-452ad5399f33 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:02.497850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbedc2-e053-4dd0-837b-452ad5399f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:02.498124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbedc2-e053-4dd0-837b-452ad5399f33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:02.502139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:02.503916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:02.526375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbedc2-e053-4dd0-837b-452ad5399f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-1dcbedc2-e053-4dd0-837b-452ad5399f33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:02.532051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:02.532952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:02.533801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 173/341] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:02.534960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8b3e-a8a1-476f-8b71-c928e38e4198 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:02.534960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8b3e-a8a1-476f-8b71-c928e38e4198 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:02.535239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8b3e-a8a1-476f-8b71-c928e38e4198 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:02.541007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 174/342] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:02.546698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:02.546992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:02.547323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:02.576577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:02.577865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:02.607122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:02.654933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 169/343] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:02.655834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:02.680898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:02.730423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 175/344] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:02.731627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:02.863641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e483fe-29b6-4c7f-a359-5dd500c2d0b0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:02.949355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:02.949998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:02.950286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:02.950572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:02.951251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:02.951581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:02.953682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:02.964028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfbd1e-cacb-4757-a0cb-643f131753fb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:02.969862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 170/345] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:02.982480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.033800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.036192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ba4cf-5451-4d45-8c7e-de57626abd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.036192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ba4cf-5451-4d45-8c7e-de57626abd14 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.036518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ba4cf-5451-4d45-8c7e-de57626abd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.036744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ba4cf-5451-4d45-8c7e-de57626abd14 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.038418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ba4cf-5451-4d45-8c7e-de57626abd14 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:03.039921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ba4cf-5451-4d45-8c7e-de57626abd14 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:03.041891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 176/346] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:02 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:03.043133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d34c-cfa8-40bd-b1b1-8814fad60751 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.043440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d34c-cfa8-40bd-b1b1-8814fad60751 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.043720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d34c-cfa8-40bd-b1b1-8814fad60751 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.044918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 177/347] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:03.048343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031d34c-cfa8-40bd-b1b1-8814fad60751 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.120931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.124624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e55c3-7954-42de-8058-200fc4b77b6b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:03.171209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.172175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.172624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.173062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.193791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031d34c-cfa8-40bd-b1b1-8814fad60751 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:03.239308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30736-fdcc-4766-bf4b-e0e93ecced02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.239308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30736-fdcc-4766-bf4b-e0e93ecced02 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.239308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30736-fdcc-4766-bf4b-e0e93ecced02 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.239308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30736-fdcc-4766-bf4b-e0e93ecced02 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.247434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30736-fdcc-4766-bf4b-e0e93ecced02 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:03.249029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30736-fdcc-4766-bf4b-e0e93ecced02 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:03.251413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 178/348] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:03.252862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.253213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.253576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.265362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:03.267470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:03.275334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:03.277028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:03.305813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.366565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 179/349] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:03.368130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.385118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 171/350] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 14:28:03.386335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.447834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.533319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80da4f0-260c-4a41-a1c4-05e8bcd1e07a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:03.551089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a560917-daac-45d7-a7b1-878d5d538baf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:03.579659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13392314-4b16-46ac-9e1f-9a9e046f1023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.580689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392314-4b16-46ac-9e1f-9a9e046f1023 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.581272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392314-4b16-46ac-9e1f-9a9e046f1023 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.581890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392314-4b16-46ac-9e1f-9a9e046f1023 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.591180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.591820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.592100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.592374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.593099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:03.593410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:03.594828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:03.596332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13392314-4b16-46ac-9e1f-9a9e046f1023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:03.596797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.604414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 172/351] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=8d82548844954170a8a5017f7a605f61 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:03.604414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-13392314-4b16-46ac-9e1f-9a9e046f1023 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:03.607010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:03.616375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 180/352] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:03.617353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f93e-7840-4320-9fde-49e607c82fca None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.618167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f93e-7840-4320-9fde-49e607c82fca None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.618167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f93e-7840-4320-9fde-49e607c82fca None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.620053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 181/353] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:03.625197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f93e-7840-4320-9fde-49e607c82fca None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.726110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5602ef-505d-4abe-bf60-0e91be184099 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:03.776241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e41c8-cdf1-45f9-9c1c-b12128cb3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.777024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e41c8-cdf1-45f9-9c1c-b12128cb3859 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.777188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e41c8-cdf1-45f9-9c1c-b12128cb3859 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.777463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e41c8-cdf1-45f9-9c1c-b12128cb3859 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.779236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e41c8-cdf1-45f9-9c1c-b12128cb3859 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:03.780868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e41c8-cdf1-45f9-9c1c-b12128cb3859 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:03.782912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 173/354] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:03.784092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.784381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.784655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.800737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f93e-7840-4320-9fde-49e607c82fca None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:03.806024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.810057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:03.811290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:03.860005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:03.860620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.861856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.861856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.861856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:03.862101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:03.863518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9ea7-5e00-4129-8798-aba51e9ca53d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:03.876014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 182/355] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:03.876561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2d01-142c-4d4e-9424-1d3ae5610941 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:03.876846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2d01-142c-4d4e-9424-1d3ae5610941 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:03.877120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2d01-142c-4d4e-9424-1d3ae5610941 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:03.879165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 183/356] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:03.880992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe2d01-142c-4d4e-9424-1d3ae5610941 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:03.903448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:03.914159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 174/357] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:03.915014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.034624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe2d01-142c-4d4e-9424-1d3ae5610941 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.043120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300a7f1-abcb-4b15-be13-bd95c8bc6107 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.073371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2364b42-b2e1-497d-a3bc-bc42d16a1788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.074008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2364b42-b2e1-497d-a3bc-bc42d16a1788 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.074292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2364b42-b2e1-497d-a3bc-bc42d16a1788 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.074719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2364b42-b2e1-497d-a3bc-bc42d16a1788 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.080086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.080733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.081016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.081293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.082402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:04.083942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:04.086075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 175/358] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:04.087423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2364b42-b2e1-497d-a3bc-bc42d16a1788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:04.091811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a2364b42-b2e1-497d-a3bc-bc42d16a1788 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:04.093135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:04.094001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:04.094908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 184/359] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:04.096252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.096252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.096252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.116814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:04.118125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:04.144765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:04.170885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:04.210806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 185/360] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:04.211920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.230615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff8eb4-0bf7-4884-8290-5eb1521011c9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.274956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.275876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.276157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.276434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.336245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb7c8c-55e6-441d-b12d-977676827d2c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.367233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:04.369233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:04.379355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.380138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.380633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.380982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.381791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:04.383541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:04.385087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:04.391458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 186/361] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:04.392337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.436752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:04.447944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:04.498436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 176/362] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:04.499850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.594651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12fac2-9ff0-46a5-b4be-bb4253040864 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.647283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ae6-fadd-462a-b5a2-034bc1c1d400 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.652788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.653402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.653680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.653954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.654616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:04.654919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:04.656865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:04.667151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 187/363] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:04.668164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.686289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.687044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.687331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.687749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.715704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:04.722354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:04.723275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:04.724861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 177/364] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:04.726128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.768375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:04.786498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:04.811894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb58f2-9ff8-436a-8be5-a7e98484e4e8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.863131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.864529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.865276 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.865853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.867354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:04.869234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:04.871642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 188/365] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:04.872673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.883013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fced904-1000-4e64-ba8e-7afe9798bfa8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:04.929487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:04.930153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:04.930442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:04.930722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:04.944391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:04.949375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:04.950255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:04.951063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 178/366] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:04.956419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:04.993768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5dc5-874c-48e6-8617-3c0dab7f9799 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.033635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.034707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.035191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.035748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] PATH_INFO: `/v3/users/2bfd72a521d940d29494c4425c24be3e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.038693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] RBAC: Authorizing `identity:get_user(user_id=2bfd72a521d940d29494c4425c24be3e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.040737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.042685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 189/367] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/users/2bfd72a521d940d29494c4425c24be3e => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.043695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.054206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.072822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321887e9-6887-4af9-ad92-58a015eb78e1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.077400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.111172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.111823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.112110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.112390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.113065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:05.113426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.115282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.125740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 179/368] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.126600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.167968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62535c-f444-4cf0-aa8f-d5aee4d0b586 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.207800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.209617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.210172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.210892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.212962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.214614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.216628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 190/369] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.217587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.237769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed903d2-24b1-4176-ac15-238868b1d831 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.275237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.275941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.276179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.276461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.277137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:05.277448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.278889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.289910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 180/370] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.290804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.308106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.332791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38733d9-48f7-4a6e-a17b-5c1166666c25 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.335916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.371468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.372201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.372672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.373052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.373899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] RBAC: Adding query filter params (role.id=19202e2098d24e4da79425e52e0a8428, user.id=2bfd72a521d940d29494c4425c24be3e, scope.system=all) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:05.374214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.375876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.390462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 191/371] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/role_assignments?user.id=2bfd72a521d940d29494c4425c24be3e&scope.system=all&role.id=19202e2098d24e4da79425e52e0a8428 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.391231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.407828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea8611-e848-48ff-bb63-35e10819ddd9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.450977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.451633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.451973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.452255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.513016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bd9d0-d94d-48ea-8220-0277adf6f232 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.534236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.535915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.549283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.560586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.561497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.561926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.562359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.563250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cd01fa208ad84752903e6cd9c998a073) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:05.563727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.565755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.574282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 192/372] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=8d82548844954170a8a5017f7a605f61 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.582433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.603803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.682165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 181/373] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:05.688085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.769592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff095-3222-4558-88a0-0a8a306b247f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.832590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba5543-d53f-4675-a218-a9d365d658a4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:05.845717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:05.849155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.850098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.850556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.850987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.883633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:05.884695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:05.885001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:05.885282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:05.888176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.890025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.893289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 182/374] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:05.901925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:05.982709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:05.984757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:05.999629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:06.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f4d0-a1bd-4c89-bb25-66ef83dff273 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:06.159669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 193/375] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:06.165520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:06.166178 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:06.166578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:06.167068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:06.169139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:06.172945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:06.175473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:06.180408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 183/376] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:05 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:06.188447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:06.264183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:06.304886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b09a-a8b3-4c12-900f-bf1a031b9c38 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:06.315077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:06.348247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b7a0-2248-4444-9955-49280500c1cc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:06.360707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:06.361461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:06.361735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:06.362014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] PATH_INFO: `/v3/projects/c72aa1856259455ba01399dfc01a267f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:06.363321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] RBAC: Authorizing `identity:get_project(project_id=c72aa1856259455ba01399dfc01a267f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:06.365835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:06.371503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 194/377] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:06 2022] GET /identity/v3/projects/c72aa1856259455ba01399dfc01a267f => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:06.373712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:06.392028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:06.392654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:06.392940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:06.393213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:06.393951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cd01fa208ad84752903e6cd9c998a073) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:06.394263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:06.395771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:06.406390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 184/378] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:06 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:06.496949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b21c0-1a0d-497b-afe0-f3b2e5423d5a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:06.539576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e86f2a-9fbc-4d6a-b07f-edf5f4730887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:06.540284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86f2a-9fbc-4d6a-b07f-edf5f4730887 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:06.540563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86f2a-9fbc-4d6a-b07f-edf5f4730887 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:06.540819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e86f2a-9fbc-4d6a-b07f-edf5f4730887 None admin] PATH_INFO: `/v3/groups/57300435bd5049d4be5c6425058c6208` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:06.546890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e86f2a-9fbc-4d6a-b07f-edf5f4730887 None admin] RBAC: Authorizing `identity:get_group(group_id=57300435bd5049d4be5c6425058c6208)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:06.548414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e86f2a-9fbc-4d6a-b07f-edf5f4730887 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:06.555589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 195/379] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:06 2022] GET /identity/v3/groups/57300435bd5049d4be5c6425058c6208 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:06.557588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:06.685891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc51ef-0b0c-44ca-bc00-0cff8dc37880 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:06.697264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:06.730985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:06.731635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:06.731916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:06.732193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:06.733010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] RBAC: Adding query filter params (group.id=57300435bd5049d4be5c6425058c6208, role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=c72aa1856259455ba01399dfc01a267f) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:06.733323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:06.734809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c62aba-ac82-4386-8eef-6782a129754f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:06.747671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 185/380] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:06 2022] GET /identity/v3/role_assignments?group.id=57300435bd5049d4be5c6425058c6208&scope.project.id=c72aa1856259455ba01399dfc01a267f&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:07.020800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ec38-d378-401a-a712-5184197a75e5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:07.021751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ec38-d378-401a-a712-5184197a75e5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:07.021995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ec38-d378-401a-a712-5184197a75e5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:07.023812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 196/381] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:07.032576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b6eb-24e2-4eda-aef6-95e0f110cb3d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:07.032576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b6eb-24e2-4eda-aef6-95e0f110cb3d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:07.032576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b6eb-24e2-4eda-aef6-95e0f110cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:07.054268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b185b6eb-24e2-4eda-aef6-95e0f110cb3d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:07.055847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b185b6eb-24e2-4eda-aef6-95e0f110cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:07.144513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 186/382] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:07.694316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201ec38-d378-401a-a712-5184197a75e5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:07.746365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:07.792407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63da3-fdf4-4b90-927f-e378ae076419 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:07.793369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63da3-fdf4-4b90-927f-e378ae076419 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:07.793971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63da3-fdf4-4b90-927f-e378ae076419 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:07.795955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 187/383] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:07.803290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:07.803889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:07.804524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:07.828744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:07.830269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:07.831439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201ec38-d378-401a-a712-5184197a75e5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:07.912648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:07.913501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:07.913785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:07.914058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:07.925682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 188/384] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:07.940113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:07.941305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:07.942917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 197/385] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:07.952226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:07.987342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:08.064215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f3d7e-96c7-4930-af54-462d195a8d08 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:08.101686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:08.102340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.102626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.102900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.103595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:08.103900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:08.105317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:08.114195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 189/386] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:08.120324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:08.231516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:08.236042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f248a-e01a-495c-a5a8-ff898944d282 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:08.276512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:08.277192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.277469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.277782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.278887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:08.280353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:08.282202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 198/387] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:08 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:08.287900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:08.397889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:08.404954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d3b66-8446-4999-8047-7b7cad18c161 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:08.442059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:08.443313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.443622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.443899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.445039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:08.446852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:08.448950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 190/388] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:08 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:08.454582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:08.505126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:08.601645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af90df-0423-49bf-9317-8b7227767910 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:08.646145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:08.646987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.647270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.647577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/groups/8a247cebd6b147179a64d8aaf41484e9/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.649504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5, group_id=8a247cebd6b147179a64d8aaf41484e9, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:08.650949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:08.654672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f8e27-0d17-40be-bccd-094b2dd6aa00 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:08.697885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf44ee4-ac53-43db-8d9d-6aa5ea389f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:08.698722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44ee4-ac53-43db-8d9d-6aa5ea389f8d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.699013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44ee4-ac53-43db-8d9d-6aa5ea389f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.699291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf44ee4-ac53-43db-8d9d-6aa5ea389f8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.712581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf44ee4-ac53-43db-8d9d-6aa5ea389f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9bf44ee4-ac53-43db-8d9d-6aa5ea389f8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:08.717543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:08.718463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:08.719298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 191/389] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:08.723395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232faa-7634-415b-adcd-66e122aded63 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.723395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232faa-7634-415b-adcd-66e122aded63 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.723395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b232faa-7634-415b-adcd-66e122aded63 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.723395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 192/390] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:08.728695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:08.728982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:08.729257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:08.736877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 199/391] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Sep 7 14:28:08 2022] PUT /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/groups/8a247cebd6b147179a64d8aaf41484e9/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:08.737722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:08.752574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:08.753859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:08.775206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:08.823833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:08.835821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 193/392] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:08.965730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8031570-a9ee-4875-8d26-3489cb4eec77 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.008944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.009552 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.009829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.010102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.010771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:09.011072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:09.012576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:09.022141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 200/393] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:09.027788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.146894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532997b-7a96-48d3-8a48-bec7545840b3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.182972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fdc8-fc92-44a1-88db-db4b4749556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.183641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fdc8-fc92-44a1-88db-db4b4749556a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.183922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fdc8-fc92-44a1-88db-db4b4749556a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.184197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fdc8-fc92-44a1-88db-db4b4749556a None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.185306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418fdc8-fc92-44a1-88db-db4b4749556a None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:09.186805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418fdc8-fc92-44a1-88db-db4b4749556a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:09.188741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 194/394] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:09 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:09.196710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.207606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8de703-e2a7-4678-8b84-87d72656c50a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.207902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8de703-e2a7-4678-8b84-87d72656c50a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.208153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8de703-e2a7-4678-8b84-87d72656c50a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.214813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 195/395] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:09.220663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.220949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.221219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.253914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:09.255108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:09.271833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:09.340470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082db2-e072-4276-8a89-ef5785d48674 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.345504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 196/396] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:09.346371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.363830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:09.391609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.392253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.392530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.392801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.393948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:09.395409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:09.402774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 201/397] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:09 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:09.403865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.488458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4314d-2740-47a4-8a00-412913b0062f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.526371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20fab4-4ab9-4740-be74-a38643ed9054 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.535403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.536397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.536786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.537065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.550620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:09.558063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:09.560285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:09.562271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 197/398] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:09.569962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.570392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.570674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.570920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.571083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/groups/8a247cebd6b147179a64d8aaf41484e9/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.573138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5, group_id=8a247cebd6b147179a64d8aaf41484e9, role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:09.574577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:09.590612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:09.670405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 202/399] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Sep 7 14:28:09 2022] PUT /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5/groups/8a247cebd6b147179a64d8aaf41484e9/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:09.702378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c269-b590-4199-80f0-0ab81249a101 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.744843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.745526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.745811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.746084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.746945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:09.747253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:09.748820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:09.764541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 198/400] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:09.769889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.784225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:09.809635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:09.884668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:09.936650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3135c4a-af57-4125-874b-21892feaec36 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.950064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20d8d-444b-4733-b6fa-f0d88104efa7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:09.984392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dcdf1-5055-4497-a3d9-e24f529d9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.985861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dcdf1-5055-4497-a3d9-e24f529d9a1e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.986316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dcdf1-5055-4497-a3d9-e24f529d9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.986742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dcdf1-5055-4497-a3d9-e24f529d9a1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.989744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d39ba-ab0a-4a17-9fbf-8c597afdb1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:09.990265 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d39ba-ab0a-4a17-9fbf-8c597afdb1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:09.990542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d39ba-ab0a-4a17-9fbf-8c597afdb1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:09.990816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d39ba-ab0a-4a17-9fbf-8c597afdb1c8 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:09.991964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d39ba-ab0a-4a17-9fbf-8c597afdb1c8 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:09.993424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d39ba-ab0a-4a17-9fbf-8c597afdb1c8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:09.995537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 203/401] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:09 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:09.999404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dcdf1-5055-4497-a3d9-e24f529d9a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:10.000907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b8f05-2149-46f5-8cb0-2a4e1071ad17 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.001205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b8f05-2149-46f5-8cb0-2a4e1071ad17 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.001481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b8f05-2149-46f5-8cb0-2a4e1071ad17 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.002980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 204/402] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:10.008269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b8f05-2149-46f5-8cb0-2a4e1071ad17 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6e8dcdf1-5055-4497-a3d9-e24f529d9a1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:10.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:10.010698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:10.011943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 199/403] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:10.013683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.013683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.013683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.038557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:10.039882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:10.117427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:10.139502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b8f05-2149-46f5-8cb0-2a4e1071ad17 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.139713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 200/404] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:10.140763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.206670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:10.207799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.208225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.209189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.213809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:10.215446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:10.217591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 205/405] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:10 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:10.225241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.258966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:10.309813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e71f0-dd11-4a65-9e3c-a5a6d003a108 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.348009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:10.348861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.349473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.350568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.351442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:10.351894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:10.353404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:10.362245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 201/406] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:10.368581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.435492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52ec15-15c5-4c51-aa05-60cc46d281cb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.483583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:10.484679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.485469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.485850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073/groups/8a247cebd6b147179a64d8aaf41484e9/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.488167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01fa208ad84752903e6cd9c998a073, group_id=8a247cebd6b147179a64d8aaf41484e9, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:10.491263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:10.529101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651cf20-630e-4604-b439-e2cc31515a2f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.555260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:10.565951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:10.566587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.566866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.567135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.569096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:10.570259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:10.572034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 202/407] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:10 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:10.572614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.620306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 206/408] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Sep 7 14:28:10 2022] PUT /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073/groups/8a247cebd6b147179a64d8aaf41484e9/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:10.621661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.642125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:10.722017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad789-4f11-444f-81fe-d8aeaa263788 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.806248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710ac6-cf82-4180-a52c-36ccefd04ca9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.818565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:10.819225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.819578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.819842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.832681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:10.840376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:10.841316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:10.842132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 203/409] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:10.848767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.862044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:10.862815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:10.863550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:10.863938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:10.866268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:10.868891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:10.871623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 207/410] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:10 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:10.877337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:10.920825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:10.965270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878844-5cb0-4754-b168-26458e655f86 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:10.971345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:10.993113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb34541-7b6e-488d-96f5-ad82fc39a345 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:11.000525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:11.001144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.001425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.001708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.002374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:11.002682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:11.004100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:11.013463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 204/411] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:11.019412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:11.031191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:11.031904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.032190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.032469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073/groups/8a247cebd6b147179a64d8aaf41484e9/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.034796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01fa208ad84752903e6cd9c998a073, group_id=8a247cebd6b147179a64d8aaf41484e9, role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:11.036400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:11.136892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c727d66-cb93-4330-b53f-f4f6d1333d63 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:11.137919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 208/412] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Sep 7 14:28:10 2022] PUT /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073/groups/8a247cebd6b147179a64d8aaf41484e9/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:11.154694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:11.178247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:11.178970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.179246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.179544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] PATH_INFO: `/v3/groups/57300435bd5049d4be5c6425058c6208` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.180709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] RBAC: Authorizing `identity:get_group(group_id=57300435bd5049d4be5c6425058c6208)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:11.182315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:11.184723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 205/413] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:11 2022] GET /identity/v3/groups/57300435bd5049d4be5c6425058c6208 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:11.190205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:11.348612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eee01-6976-4081-a558-56bbadc9d827 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:11.388587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c81580-cf2e-4fef-acec-fb629827dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:11.389289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81580-cf2e-4fef-acec-fb629827dbbc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.389577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81580-cf2e-4fef-acec-fb629827dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.389849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81580-cf2e-4fef-acec-fb629827dbbc None admin] PATH_INFO: `/v3/projects/c72aa1856259455ba01399dfc01a267f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.390990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c81580-cf2e-4fef-acec-fb629827dbbc None admin] RBAC: Authorizing `identity:get_project(project_id=c72aa1856259455ba01399dfc01a267f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:11.392504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c81580-cf2e-4fef-acec-fb629827dbbc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:11.394548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 209/414] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:11 2022] GET /identity/v3/projects/c72aa1856259455ba01399dfc01a267f => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:11.400431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:11.532050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761126-1ffc-4ca8-8ec1-8d8b3f4e1a14 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:11.534080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e458-2cc4-4623-b396-4982edac76a7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.534360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e458-2cc4-4623-b396-4982edac76a7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.535408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e458-2cc4-4623-b396-4982edac76a7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.536051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 210/415] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:28:11.542076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.542634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.543136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.577138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:11.578611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:11.595268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:11.596024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:11.596314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:11.596597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] PATH_INFO: `/v3/projects/c72aa1856259455ba01399dfc01a267f/groups/57300435bd5049d4be5c6425058c6208/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:11.598521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] RBAC: Authorizing `identity:create_grant(project_id=c72aa1856259455ba01399dfc01a267f, group_id=57300435bd5049d4be5c6425058c6208, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:11.599860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:11.604661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:11.653806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 211/416] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:11.708158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 206/417] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Sep 7 14:28:11 2022] PUT /identity/v3/projects/c72aa1856259455ba01399dfc01a267f/groups/57300435bd5049d4be5c6425058c6208/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:28:12.036227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:12.141553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27959f-2054-4727-a136-7c9901fc851e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:12.186838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e549f0-5a36-4f60-b85a-faa4f3957ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:12.187486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e549f0-5a36-4f60-b85a-faa4f3957ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:12.187767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e549f0-5a36-4f60-b85a-faa4f3957ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:12.188037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e549f0-5a36-4f60-b85a-faa4f3957ca9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:12.201301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:12.206199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e549f0-5a36-4f60-b85a-faa4f3957ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-02e549f0-5a36-4f60-b85a-faa4f3957ca9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:12.212298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:12.213227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:12.214038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 212/418] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:12.221344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:12.305255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:12.319478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23d0d3-3319-4c51-9f7c-61b2a821ffea None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:12.319769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23d0d3-3319-4c51-9f7c-61b2a821ffea None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:12.320044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23d0d3-3319-4c51-9f7c-61b2a821ffea None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:12.322244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 213/419] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:12.327417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:12.327739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:12.328016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:12.347309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:12.348562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:12.414068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ffc18-e71e-495b-943d-b27ada84025a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:12.429282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:12.471202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:12.472071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:12.472511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:12.472926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:12.473729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] RBAC: Adding query filter params (name=member) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:12.474791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:12.480498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:12.489393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 207/421] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:12.496023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:12.621990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3917c-4f4e-4c91-a8b0-e1a086db9c91 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:12.650038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:12.662948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:12.663780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:12.664327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:12.664739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:12.741596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:12.743261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:12.816306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:12.865210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 215/422] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:12.871980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:12.943741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.027195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3739c-68ef-4969-a6c5-66a5d1a87524 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.035124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.090501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.091148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.091454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.091734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.097853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f77cde-bef3-4ec0-85e7-62511d75bfbf None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.117039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:13.131697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:13.132612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:13.133436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 208/423] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:13.141388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:13.148678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.149384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.149669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.149942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.155256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:13.156739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:13.158362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 216/424] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:12 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:13.168279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:13.264280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf99dad-21fc-4a5d-9fcf-a81684cd63a7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.300900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.301436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.301729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.302551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.303368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:13.303710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:13.305117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:13.315056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 209/425] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:13.324003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:13.355758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.398976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.409436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d1cb-5a68-4437-b13f-4c93d51e5245 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.438483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2306-3cca-4b04-a043-42cb66e666b8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.481322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.482221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.482764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.483055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.485119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443b160-3c8e-46a9-971e-2cb72c813d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.486168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443b160-3c8e-46a9-971e-2cb72c813d23 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.486534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443b160-3c8e-46a9-971e-2cb72c813d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.486884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443b160-3c8e-46a9-971e-2cb72c813d23 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.489818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443b160-3c8e-46a9-971e-2cb72c813d23 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:13.491696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443b160-3c8e-46a9-971e-2cb72c813d23 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:13.494950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 217/426] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:13 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:13.499777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4fb7f-ab3b-4600-957f-b60dce505cd3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.500068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4fb7f-ab3b-4600-957f-b60dce505cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.500345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4fb7f-ab3b-4600-957f-b60dce505cd3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.503465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 218/427] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:13.504329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4fb7f-ab3b-4600-957f-b60dce505cd3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:13.589485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:13.591552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:13.625690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4fb7f-ab3b-4600-957f-b60dce505cd3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.629379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.665557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.665923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.666205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.666482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.667219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:13.667583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:13.669031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf28715-5e10-4e31-9ac0-46452b848c25 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:13.681336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 219/428] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:13 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=8d82548844954170a8a5017f7a605f61 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:13.681336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f322a8-6bae-4c7b-b5c1-c74b278c48db None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.681336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f322a8-6bae-4c7b-b5c1-c74b278c48db None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.681336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f322a8-6bae-4c7b-b5c1-c74b278c48db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.712863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-65f322a8-6bae-4c7b-b5c1-c74b278c48db None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:13.714472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65f322a8-6bae-4c7b-b5c1-c74b278c48db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:13.750093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 210/429] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:13.757707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:13.765877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.877189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 220/430] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:13.892967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9dcab-06e7-4038-94e0-d0fede0612ed None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:13.933432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:13.943543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:13.944251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.951889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.951889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] PATH_INFO: `/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.951889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] RBAC: Authorizing `identity:get_project(project_id=cbb4e3d6c3f24c09a94b794e38c13bc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:13.951889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:13.951889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 211/431] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:13 2022] GET /identity/v3/projects/cbb4e3d6c3f24c09a94b794e38c13bc5 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:13.952238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e23d7-9440-46df-90ee-37ebdd24e919 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.952238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e23d7-9440-46df-90ee-37ebdd24e919 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.952238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e23d7-9440-46df-90ee-37ebdd24e919 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.952852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 221/432] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:28:13.956643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:13.961255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:13.961565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:13.961807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:13.997997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:13.999196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:14.066337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16284-34ca-4d0f-a3d7-cd10c04cc141 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.103794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 222/433] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:14.115011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.116031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.116526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.117026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.118399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:14.120078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:14.122201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 212/434] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:13 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:14.127654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:14.201411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:14.231713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:14.245696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97204635-0b67-480d-96c6-3ce0da624bba None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.283454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.284074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.284358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.284634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.285364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:14.285675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:14.287201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:14.293790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 223/435] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cbb4e3d6c3f24c09a94b794e38c13bc5&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:14.294890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:14.342952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4f8a-a1b6-44d8-a439-93273457fa6a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.384028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.385013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.385489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.385975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.399621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:14.405687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:14.406686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 14:28:14.407580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:14.412517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 213/436] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:14.415913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:14.418552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:14.555906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb153f-6319-4c91-affd-6e3dc530eaaa None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.568972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b954-345b-4ed0-b0b4-32be9d9186b9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.597725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:14.604945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.612137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.612137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.612137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.612137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] RBAC: Adding query filter params (name=member) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:14.612137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:14.612137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d489e8-0d68-4b49-8f4b-82ae7a410f2a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:14.612724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273809-2295-42bb-ad05-f6033f157764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.614198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273809-2295-42bb-ad05-f6033f157764 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.614198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273809-2295-42bb-ad05-f6033f157764 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.614198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273809-2295-42bb-ad05-f6033f157764 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.618348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 224/437] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:14.619737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42717-78b7-4212-a4fb-6b412a842d4c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.620024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42717-78b7-4212-a4fb-6b412a842d4c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.620299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42717-78b7-4212-a4fb-6b412a842d4c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.621555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 225/438] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:14.624483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42717-78b7-4212-a4fb-6b412a842d4c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:14.632696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01273809-2295-42bb-ad05-f6033f157764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-01273809-2295-42bb-ad05-f6033f157764 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:14.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:14.639133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:14.640112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:14.642386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 214/439] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:14.642779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:14.644055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.644337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.644611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.664597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:14.665818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:14.773563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42717-78b7-4212-a4fb-6b412a842d4c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.774650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 215/440] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:14.775531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:14.838222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.838851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.839134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.840020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.906711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa210a0-0df0-47b3-bb04-20b6abb8d3b9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:14.921643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:14.940685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:14.942215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:14.947900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:14.948521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:14.948807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:14.949081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:14.949758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:14.950064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:14.951491 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:14.960594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:14.967407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 216/441] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:14.968717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.065224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 226/442] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:15.071275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.080958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817cc4-ea8a-49d2-ae47-d85a31842fe9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.124788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.125412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.125788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.125975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.173969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.202426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d13a0-7228-4955-80a6-b0c247335f34 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.203781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.205223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.219411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.241055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.241694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.241978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.242257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.243483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.245111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.246755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 227/443] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:15.251334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.313591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 217/444] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:15.315102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.354149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb1b5e-4e86-47b2-9225-0c66210287dc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.392280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.392911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.393192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.393466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.397627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.404880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:15.409708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:15.417167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 228/445] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:15.417977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.422676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dc94e-0ab1-472c-b7ba-0178b3c0dd14 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.459489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.460660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.461144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.461637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.463647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.463817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.465970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.468196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 218/446] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:15.472794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.528987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8197-2bbb-4efd-aa96-7e9ca113b4d1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.563289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.563942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.564224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.564499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] PATH_INFO: `/v3/projects/cd01fa208ad84752903e6cd9c998a073` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.565614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01fa208ad84752903e6cd9c998a073)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.567055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.569399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 229/447] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/projects/cd01fa208ad84752903e6cd9c998a073 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:15.570157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.579853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da844-8783-4c02-adaf-03a792b071b0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.613250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.613858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.614145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.615045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.615862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:15.616170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.617580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.625785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 219/448] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:15.626685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.631854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.671821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7655b-61de-444e-9dac-0d649ccb7bf6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.683188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.707592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.708278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.708625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.709041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.709817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=8d82548844954170a8a5017f7a605f61, scope.project.id=cd01fa208ad84752903e6cd9c998a073) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:15.710074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.711782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.717526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 230/449] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=8d82548844954170a8a5017f7a605f61 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:15.718209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.738626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b2d5d-1ac5-432c-a245-d35620be57a5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.782570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.783224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.783550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.783829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] PATH_INFO: `/v3/groups/8a247cebd6b147179a64d8aaf41484e9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.785140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] RBAC: Authorizing `identity:get_group(group_id=8a247cebd6b147179a64d8aaf41484e9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.787316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.789040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 220/450] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/groups/8a247cebd6b147179a64d8aaf41484e9 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:15.795110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:15.837757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0937-033f-4555-900b-87d6bb528e9e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.879667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.882481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.883357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.883732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.884012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.919200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac674b-58bd-4978-a351-5e424e2e06c3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:15.950041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:15.972492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:15.973340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:15.973848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:15.974302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:15.975332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] RBAC: Adding query filter params (group.id=8a247cebd6b147179a64d8aaf41484e9, role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=cd01fa208ad84752903e6cd9c998a073) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:15.978692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.979737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:15.988652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 221/451] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/role_assignments?group.id=8a247cebd6b147179a64d8aaf41484e9&scope.project.id=cd01fa208ad84752903e6cd9c998a073&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:15.989080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:15.992143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:16.115024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 231/452] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:16.120761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:16.228963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdd22c-d2ed-4eb2-82f5-811105093de5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:16.266598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:16.267241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:16.267558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:16.267835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] PATH_INFO: `/v3/projects/c72aa1856259455ba01399dfc01a267f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:16.269015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] RBAC: Authorizing `identity:get_project(project_id=c72aa1856259455ba01399dfc01a267f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:16.270439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:16.272374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 222/453] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:28:16 2022] GET /identity/v3/projects/c72aa1856259455ba01399dfc01a267f => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:16.277923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:16.357712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:16.383564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19edbe-0125-4990-8d1b-61833a9556e7 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:16.416471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbe3a8-6a24-45d8-8814-f225f4806ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:16.417096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe3a8-6a24-45d8-8814-f225f4806ebd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:16.417380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe3a8-6a24-45d8-8814-f225f4806ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:16.417655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe3a8-6a24-45d8-8814-f225f4806ebd None admin] PATH_INFO: `/v3/groups/57300435bd5049d4be5c6425058c6208` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:16.418747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbe3a8-6a24-45d8-8814-f225f4806ebd None admin] RBAC: Authorizing `identity:get_group(group_id=57300435bd5049d4be5c6425058c6208)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:16.420213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbe3a8-6a24-45d8-8814-f225f4806ebd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:16.421755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 232/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Sep 7 14:28:16 2022] GET /identity/v3/groups/57300435bd5049d4be5c6425058c6208 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:16.428150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:16.431965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:16.527039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23acc8d-5d09-49dc-8ffc-0ed042b73dfc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:16.559433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:16.560026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:16.560314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:16.560594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:16.561313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] RBAC: Adding query filter params (group.id=57300435bd5049d4be5c6425058c6208, role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=c72aa1856259455ba01399dfc01a267f) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:16.561628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:16.563041 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48158eab-d3fc-48f3-8aff-705f996ab2ce None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:16.569432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 223/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Sep 7 14:28:16 2022] GET /identity/v3/role_assignments?group.id=57300435bd5049d4be5c6425058c6208&scope.project.id=c72aa1856259455ba01399dfc01a267f&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:19.101095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f369-924f-426d-ac34-99bbd8f79a47 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.102137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f369-924f-426d-ac34-99bbd8f79a47 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.102627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f369-924f-426d-ac34-99bbd8f79a47 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.104522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 233/456] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:19.109754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059540-7df8-459d-8365-6ea8a7fa4bec None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.110167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059540-7df8-459d-8365-6ea8a7fa4bec None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.110299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059540-7df8-459d-8365-6ea8a7fa4bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.136604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d0059540-7df8-459d-8365-6ea8a7fa4bec None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:19.138119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d0059540-7df8-459d-8365-6ea8a7fa4bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:19.224667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:19.230519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 224/457] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:19.718498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b2a4-d437-4494-9f95-ca2931c8f985 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.719111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b2a4-d437-4494-9f95-ca2931c8f985 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.719631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5b2a4-d437-4494-9f95-ca2931c8f985 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.721497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 234/458] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:19.727935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75349fa-0369-4273-86aa-2534b6d4447b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.728563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75349fa-0369-4273-86aa-2534b6d4447b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.729064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75349fa-0369-4273-86aa-2534b6d4447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.729887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b2a4-d437-4494-9f95-ca2931c8f985 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:19.758745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d75349fa-0369-4273-86aa-2534b6d4447b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:19.760103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d75349fa-0369-4273-86aa-2534b6d4447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:19.835846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 225/459] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:19.837690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582b9bb-5446-4015-ba03-bf2f3229f60f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.838116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582b9bb-5446-4015-ba03-bf2f3229f60f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.838537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582b9bb-5446-4015-ba03-bf2f3229f60f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.840059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 226/460] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:19.845499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd236b-aa56-4408-bd01-6d2554a05009 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.845998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd236b-aa56-4408-bd01-6d2554a05009 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.846443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd236b-aa56-4408-bd01-6d2554a05009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.867453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5b2a4-d437-4494-9f95-ca2931c8f985 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:19.872783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-19cd236b-aa56-4408-bd01-6d2554a05009 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:19.874249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-19cd236b-aa56-4408-bd01-6d2554a05009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:19.913057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:19.919330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.919830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.920300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.935499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:19.937319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:19.947739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0509af96-c2ab-4924-9a7f-12bdb021243d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:19.953247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:19.954151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:19.955010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:19.955010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:19.955010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:19.958785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 227/462] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:19.960225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2083d-f3ad-48b2-a2d0-98c9939e586b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.961024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2083d-f3ad-48b2-a2d0-98c9939e586b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.961426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2083d-f3ad-48b2-a2d0-98c9939e586b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:19.962973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 235/463] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:19.963109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 228/463] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:19.964256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2083d-f3ad-48b2-a2d0-98c9939e586b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:19.968277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:19.983541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:19.983541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.006519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:20.007986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:20.034262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:20.088198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2083d-f3ad-48b2-a2d0-98c9939e586b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.122550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 236/464] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:20.124102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.130938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.131599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.131885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.132160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.132814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:20.133120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.134523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.154575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 229/465] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:20.161001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39892ab2-14f6-4670-9c12-c23de1200c2d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.264640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:20.275750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.282782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.282782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.282782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.289372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.291187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:20.309437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:20.310439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:20.311295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:20.311295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:20.311295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:20.313107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 237/466] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:20.317371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059cab6-42b3-4e3a-96e3-c992a8be668a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.324947 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.363743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:20.383725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.384342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.384631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.384908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.385565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.387016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.464939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d03889-a9a0-44cb-9868-c1198ecddef9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.479812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 230/467] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:28:20 2022] POST /identity/v3/users => generated 246 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:28:20.481115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.513306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.514198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.516723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.516723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.516723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:20.516723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.518826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.548403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 238/468] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:20.550221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.596524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:20.647047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1c980-a870-461e-89c1-1ffbe509fa50 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.691411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.691411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.691411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.691759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.696904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156f4e-a107-42ad-9439-80d4ec45d0b8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.703718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.705585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:20.725479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:20.729026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:20.729912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:20.729912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:20.729912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:20.729912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 231/469] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:20.729912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.747719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.748363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.748652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.748927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.760641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.762209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:20.780220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:20.781157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:20.782722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:20.782722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:20.782722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:20.782722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 239/470] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:20.782722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:20.794698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:20.877637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac5bf-fba8-4627-b00a-078761ec6b5c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.883611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:20.896664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d472ec1-a51c-4038-af83-911a71c05a8f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:20.918988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.919638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.920017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.920282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.920849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.922304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.936967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:20.937609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.937895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.938171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.938821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:20.939130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:20.940570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9613cd-9fcf-4b95-8ca9-23f127e575ae None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:20.953281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 240/471] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:20.954496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6190c-f1a1-4990-bd6b-4defc7829ac3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:20.954782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6190c-f1a1-4990-bd6b-4defc7829ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:20.955056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6190c-f1a1-4990-bd6b-4defc7829ac3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:20.958889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 241/472] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:20.958889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6190c-f1a1-4990-bd6b-4defc7829ac3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:21.013354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 232/473] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:28:20 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:21.014180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:21.093714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6190c-f1a1-4990-bd6b-4defc7829ac3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:21.132921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:21.133670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:21.133959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:21.134120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:21.134736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:21.135039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:21.136560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3f90e-c047-42d1-a5a0-482b53d37925 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:21.138115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:21.151008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 242/474] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:21.152605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:21.153047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:21.153481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:21.163548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a43d8-7070-43ee-a20e-204e7b6f5f45 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:21.174205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:21.175892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:21.178455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:21.215776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:21.216391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:21.216734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:21.216948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:21.217600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:21.220587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:21.262802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 243/475] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:21.263529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:21.321909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 233/476] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:28:21 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:21.385974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca74df-97d8-4726-9b5e-0b61e4aca2ee None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:21.423904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:21.424523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:21.424800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:21.425069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:21.425724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:21.427408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:21.438194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:21.549757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:21.573106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 244/477] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:28:21 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:21.678526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709f33d-de81-4be7-a2d1-ce910f7fee4b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:21.722058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:21.722682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:21.722964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:21.723238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:21.724281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:21.725863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:21.788082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.sql.core [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 14:28:21.788082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 14:28:21.788082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [parameters: {'id': 'eed6301bd19f4c0b89927567f8756768', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 14:28:21.788082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81762) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application conn.query(q) Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result.read() Sep 07 14:28:21.804793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 14:28:21.805763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application next(self.gen) Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application yield resource Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application next(self.gen) Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise self.value Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application session.commit() Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 14:28:21.806707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.session.flush() Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application compat.raise_( Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 14:28:21.807622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 14:28:21.808586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application conn.query(q) Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application result.read() Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 14:28:21.811085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [parameters: {'id': 'eed6301bd19f4c0b89927567f8756768', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:21.813191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 14:28:21.815161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:21.817322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 234/478] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Sep 7 14:28:21 2022] POST /identity/v3/roles => generated 144 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:21.823738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:21.944048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e06e-8dee-47d1-8545-7d903883a6f4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:21.986363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b2109-283c-40a0-8ed7-ee4428cbc7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:21.986997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b2109-283c-40a0-8ed7-ee4428cbc7cf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:21.987272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b2109-283c-40a0-8ed7-ee4428cbc7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:21.987570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b2109-283c-40a0-8ed7-ee4428cbc7cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:21.998758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b2109-283c-40a0-8ed7-ee4428cbc7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d83b2109-283c-40a0-8ed7-ee4428cbc7cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:22.005479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:22.006788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:22.007639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 245/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:28:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:22.014618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:22.017646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:22.122046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798f95c-7be3-4739-831f-951f21756353 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:22.158797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:22.159575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:22.159732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:22.159969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:22.160640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:22.161042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:22.162509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb72075-966b-4ce3-bfaf-46128f7304df None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:22.171399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 235/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:23.067974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb3e7-ec19-4d68-aed8-63c1275909d5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:23.068786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb3e7-ec19-4d68-aed8-63c1275909d5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:23.068786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb3e7-ec19-4d68-aed8-63c1275909d5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:23.070507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 246/481] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:23.076629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caae42-3345-4441-86a7-34e982d17ec7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:23.077218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caae42-3345-4441-86a7-34e982d17ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:23.077730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caae42-3345-4441-86a7-34e982d17ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:23.098706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-35caae42-3345-4441-86a7-34e982d17ec7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:23.100954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-35caae42-3345-4441-86a7-34e982d17ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:23.186346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:23.201115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 236/482] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:23.697173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb3e7-ec19-4d68-aed8-63c1275909d5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:23.773571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:23.777846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f69c8-5add-45be-a2ae-b24ce90d3391 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:23.778136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f69c8-5add-45be-a2ae-b24ce90d3391 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:23.778416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f69c8-5add-45be-a2ae-b24ce90d3391 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:23.779934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 237/483] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:23.795578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:23.795882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:23.796145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:23.823789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:23.824998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:23.871449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb3e7-ec19-4d68-aed8-63c1275909d5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:23.923313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:23.924430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:23.925870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:23.926587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:23.946052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:23.951418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:23.952292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:23.953116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:23.955012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 247/484] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:23.956423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 238/485] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:23.968493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.110071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085e89f-ff38-4452-82e8-6b1766207df9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:24.142873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:24.159141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:24.164479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.164479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.164479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.164479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:24.164479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:24.164479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:24.179214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 239/486] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:24.184735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.261792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.344103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a265980-1dcc-40c8-b6ed-c5185f41f19e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:24.367406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:24.375272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa5a4-abaa-4f92-a558-7ebf42daf586 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:24.393561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:24.394198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.394479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.394758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.405977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:24.407468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:24.414345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3ab3-ecc0-4d09-aa29-3e1ed7f59ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:24.414967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3ab3-ecc0-4d09-aa29-3e1ed7f59ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.415247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3ab3-ecc0-4d09-aa29-3e1ed7f59ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.415548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3ab3-ecc0-4d09-aa29-3e1ed7f59ec2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4d93b6cd-1662-40d9-934c-8ff0f17a1878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:24.423177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:24.424094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:24.424957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:24.424957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:24.424957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:24.424957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 248/487] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:24.425882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860cd2-3291-49bb-97af-c8649e52ea7b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.426170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860cd2-3291-49bb-97af-c8649e52ea7b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.426444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860cd2-3291-49bb-97af-c8649e52ea7b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.428298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 249/488] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:24.429334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3ab3-ecc0-4d09-aa29-3e1ed7f59ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:24.429969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d89f4-2dec-4ef9-8f9c-1711a07720e5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.430453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d89f4-2dec-4ef9-8f9c-1711a07720e5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.430975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d89f4-2dec-4ef9-8f9c-1711a07720e5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.432633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 250/489] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:24.433791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d89f4-2dec-4ef9-8f9c-1711a07720e5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-adae3ab3-ecc0-4d09-aa29-3e1ed7f59ec2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:24.435267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:24.436210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 240/490] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:24.441924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa94f7-2a8c-4d87-8cd2-2968069a7b76 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.442729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa94f7-2a8c-4d87-8cd2-2968069a7b76 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.442729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa94f7-2a8c-4d87-8cd2-2968069a7b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.466495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-36fa94f7-2a8c-4d87-8cd2-2968069a7b76 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:24.467871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-36fa94f7-2a8c-4d87-8cd2-2968069a7b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:24.519332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:24.545459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 241/491] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:24.546910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.547203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.547511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.556357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d89f4-2dec-4ef9-8f9c-1711a07720e5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:24.578445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:24.579998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:24.600116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:24.600780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.601650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.601881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.602529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:24.602841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:24.604316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:24.621210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 251/492] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:24.622428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.658698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:24.660973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 242/493] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:24.662427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.748588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520679-322d-4ef6-acc1-a87b6c9078c2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:24.788331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b51ad-5aed-446d-a591-b51d94731319 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:24.788976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:24.789836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.790315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.790797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.791709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:24.792216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:24.793802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:24.798459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:24.804789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 252/494] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:24.816715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.845479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:24.846146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:24.846423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:24.846697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:24.858757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:24.860224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:24.889817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:24.890798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:24.891763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 243/495] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:24.897365 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:24.944985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:24.970751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e922-29a5-419f-a334-50cc9c312e74 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.016712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.017601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.017886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.018159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.023667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca92b9-78a4-48a3-80a9-e7c4b70d7121 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.031621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.033086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:25.048380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:25.049477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:25.050332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:25.050332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:25.050332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:25.050332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 253/496] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:25.050549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.065932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.066541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.066825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.067127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.068102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:25.068421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.069853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.113125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 244/497] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:28:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:25.113125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.138336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.171365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89559ba-7627-4412-be39-006c8c867f96 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.219062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.219788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.219994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.220267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.229539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.231162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee0af4-dad0-4caa-a207-9e59a59615bc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.232892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:25.237760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:25.238857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:25.240773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:25.244502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 254/498] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:25.245493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.274630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.275285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.275617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.276218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.287850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:25.292611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:25.293506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 245/499] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:25.295202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.356629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ee00-341d-4b02-94f3-a4aa790f8dac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.376822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.389783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.390387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.390670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.390944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.391621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:25.391737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567702-5f9d-48f2-b6b3-0e1e076bf9b1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.391929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.393323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.408275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 255/500] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:25.412299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.429469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b03c4c-1db6-4846-aaee-13ae3155bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.430076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b03c4c-1db6-4846-aaee-13ae3155bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.430355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b03c4c-1db6-4846-aaee-13ae3155bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.430625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b03c4c-1db6-4846-aaee-13ae3155bbe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.469504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.501510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b03c4c-1db6-4846-aaee-13ae3155bbe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.503100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b03c4c-1db6-4846-aaee-13ae3155bbe0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.511904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a514c59-4d36-47ad-8dd4-060732d12a80 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.545146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.545736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.546016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.546285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.546934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:25.547233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.548634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.557635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 256/501] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:25.558223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.591297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.608468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 246/502] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:25.609637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f293b-9b51-4e23-8593-6daa3d9bffb0 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.609928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f293b-9b51-4e23-8593-6daa3d9bffb0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.610207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f293b-9b51-4e23-8593-6daa3d9bffb0 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.611752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 247/503] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:25.612462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f293b-9b51-4e23-8593-6daa3d9bffb0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.665439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deff0d-3480-401d-a7dc-27fb6f052f2a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.688669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.700085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.700686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.700963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.701225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.701883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:25.702186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.703631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.712238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 257/504] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:25.713165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.720148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f293b-9b51-4e23-8593-6daa3d9bffb0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.754498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.755748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.756108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.756419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.763440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.764874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:25.776301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:25.777238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 248/505] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:25.778153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.822013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7cca8-0dec-4468-b0d8-53709a944b76 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.830008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.856574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.857194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.857476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.857751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.868517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.869895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-df8faf0d-6b24-43bd-ab59-780a5a10195b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:25.884466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:25.885587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:25.886512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:25.886512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:25.886512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:25.886689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb27a-9da5-4fd2-bb76-bbf6cb3da383 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:25.886762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 258/506] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:25.887109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.887415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.887691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.905330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:25.906534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:25.923634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:25.924268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:25.924550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:25.924827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:25.935655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:25.937089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:25.938218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:25.951722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:25.952789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:25.953644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:25.953644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:25.953644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:25.953644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 249/507] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:25.953893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:25.981025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 259/508] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:25.981851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.054672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.060828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4c380-7d3f-45ba-b1f0-d74ab7295e7e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.098508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.099564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.099859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.100130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.107663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b0f9-4e93-4367-ae91-68150488cef6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.111017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.112515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:26.128312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:26.129232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:26.130734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:26.130734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:26.130734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:26.130734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 250/509] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:26.130987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.151484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.152090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.152367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.152724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.153358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:26.153654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.155077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.191757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 260/510] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Sep 7 14:28:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:26.192946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.221168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.248509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7a4a-56b4-473b-acca-456a503db8b1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.289702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.290362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.290572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.290849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.291579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:26.291843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.293216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.305757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 251/511] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:26.306576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.307564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd434032-7102-4f72-8ed3-739d4bad0b42 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.318465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.343198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.343830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.344106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.344377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.345004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:26.345302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.346688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.358203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 261/512] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:26.359199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.408553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41489-45b5-4731-87d0-b3bb33dae5b3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.441015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.441619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.441904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.442774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.443671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:26.443989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.445360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.446245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.456503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 252/513] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:26.457302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.462840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f39e8-2975-4c69-b8cb-ceffcde096f2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.500228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.500834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.501114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.501391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.526121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.559523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acae1b-5de6-4bc6-9a5e-839723f77cea None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.569854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.571400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.598862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.599855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.600148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.600426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.612327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.613771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:26.629994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:26.631147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:26.632052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:26.632052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:26.632052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:26.632052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 253/514] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:26.632297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.663942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.680828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 262/515] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:26.681647 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.737828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c021-3121-4542-8578-b1e3dfc6caba None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.758736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.772787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.773414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.773692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.773963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.781253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.781756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809711-debf-4d23-b108-57b13f8e3568 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.782678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:26.794277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:26.795217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 254/516] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:26.796171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.819603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.820241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.820523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.820797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.827313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.828782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:26.841892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:26.842787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 263/517] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:26.843839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.889741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:26.902009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88259-f955-4bc1-bb0e-d047fdea05e0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.939741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.940377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.940658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.940930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.949244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55a2bc-32fd-42ed-96ae-e44d82459ac1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:26.950420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.951915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:26.964593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:26.965557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 255/518] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:26.966454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:26.992479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:26.993080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:26.993357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:26.993627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:26.994256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:26.994563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:26.995990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.007494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 264/519] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:27.008311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.013076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.066769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a55d3-3a30-4331-8822-047dc9c8ff4a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.100980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.101718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.102054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.102341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.113512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.113724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55666979-7faf-4c93-b40a-eafd84d33946 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.115061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.116228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:27.129269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:27.130861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:27.131766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:27.131766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:27.131766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:27.131766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 256/520] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:27.131985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.154106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.154700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.154976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.155246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.155989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:27.156293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.157755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.175757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 265/521] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:27.176644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.228255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.237861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ee6e6-f494-419e-bf13-af2a84a1dc68 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.274060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.274660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.274939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.275209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.275926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:27.276230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.277199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcef16-e239-4273-a5c9-81e15af3e76c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.277643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.295144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 257/522] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:27.295977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.312613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.313212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.313485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.313751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.314466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:27.314773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.316249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.334204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 266/523] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:27.335001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.357959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.398537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6e54-c88c-4b13-885e-587b26e4bb1b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.435272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.435930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.436229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.436489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.437132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.437225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63b4f9-437e-428d-9718-b85559f92ad9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.438560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.471960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.472557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.476013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.476013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.476013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:27.476013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.476013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.486929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 267/524] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:27.487687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.525221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 258/525] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:28:27 2022] POST /identity/v3/users => generated 247 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:27.526186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.540026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.578626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.602411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe173-ff5d-4f1f-88c4-03a24c13326f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.641977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a237faf-c217-47af-b237-01f847a4ea52 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.644799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.645957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.646236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.646597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.684492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.685455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.685742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.686022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.686762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=2c129868b68642ccab8686ed6fe22906) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:27.687077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.688571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.695689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 259/526] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/role_assignments?user.id=2c129868b68642ccab8686ed6fe22906&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:27.696545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.753324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.755310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:27.806742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.845525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe71a84-611a-44bc-838e-0dab06c8838f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:27.865555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:27.894881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:27.895294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 268/527] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:27.896358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:27.896469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:27.896946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:27.897443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:27.985798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:27.987262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.021700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf691e-9290-47bc-9327-3e1bd0856541 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.060724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.064815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.065728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.066212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.066684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.074422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.076241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:28.089259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:28.090228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:28.091125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:28.092928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 260/528] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:28.094399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 269/529] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:28.096283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.097736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.151721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.216534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0fa4-bafc-4fc9-911b-583850fe0d6a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.234488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572256b7-3e09-44b7-8f75-c2b0c6e4b8e9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.252743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.253376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.253664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.253939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.264449 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.265714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:28.281080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:28.282011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:28.282863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:28.282863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:28.282863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:28.283893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.285078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.285546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.286110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.286751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 261/530] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:28.287616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.299058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.300664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:28.317406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:28.318389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:28.319230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:28.319230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:28.319230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:28.323073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 270/531] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:28.323848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.324282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.415037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cf2e5-e145-42af-99b5-1cbb7bee080d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.442333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.456046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aa0de-83a9-472d-8365-fc4986c1e5e8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.457097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.458684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.460038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.460769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.461672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:28.462197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.463900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.482373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 262/532] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:28.483813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.494131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.494738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.495015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.495286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.495960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:28.496261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.497780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.515110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 271/533] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:28.516056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.597084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.616604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294580-888f-41dc-9d45-6f631b8cf3b8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.639924 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378e23-4ae9-4f00-9a20-f5c2075534a5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.655270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.656173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.656657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.657142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.657984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:28.658481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.660116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.673056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 263/534] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:28.674170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.681004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.681707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.681994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.682270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.683001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=95f7c352378a4bc08f1d1acddae20cac) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:28.683310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.684830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.691267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 272/535] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/role_assignments?user.id=95f7c352378a4bc08f1d1acddae20cac&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:28.692737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.714842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.790445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58a25-150d-46d5-88aa-5e9185fb502c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.818820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74fe68-b2c6-44d6-9156-70adb11ab504 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:28.839450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.840471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.840960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.841530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.852986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.856530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:28.880706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:28.881633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:28.882644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:28.893548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 264/536] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:28.899130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:28.899865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:28.900772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:28.903341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:28.903861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:28.907246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:28.923992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:28.925626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:28.942945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:28.943881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:28.944727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 273/537] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:28.950610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:29.036946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af859-8984-4bf2-98ff-5e10913f52fa None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:29.073384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:29.106490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567991b-7ea2-4855-83fb-c835fb863b73 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:29.119093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:29.119735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:29.120022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:29.120300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:29.121066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:29.121381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:29.122951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:29.148873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 265/538] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:29.156439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:29.178100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:29.178720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:29.179148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:29.179451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:29.181073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:29.181390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:29.183069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:29.205370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 274/539] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:29.212396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:29.277904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:29.348042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca635c-ac35-4808-8cee-db27da7fecc6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:29.386340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:29.386874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:29.387160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:29.387561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:29.388412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=3c333a75ebd74779acf201947470a92e) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:29.388735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:29.390176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41375bb-fbab-4a07-abec-09bb813bc96b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:29.394289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a23971-e106-4135-b8be-f6c933a24a47 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:29.396117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 266/540] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:29 2022] GET /identity/v3/role_assignments?user.id=3c333a75ebd74779acf201947470a92e&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:29.457188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:29.457950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:29.458231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:29.458506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:29.459281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=b3493b21604b404391be7b8909461d75) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:29.459618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:29.461373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b06a3-9ae2-4dc2-a900-3c0b75800134 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:29.464889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:29.469134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 275/541] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:29 2022] GET /identity/v3/role_assignments?user.id=b3493b21604b404391be7b8909461d75&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:30.009626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43805db8-acaa-4cd5-b47b-14095eb4bd30 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:30.009958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43805db8-acaa-4cd5-b47b-14095eb4bd30 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:30.010174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43805db8-acaa-4cd5-b47b-14095eb4bd30 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:30.011954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 267/542] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:30.017921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:30.018239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:30.018471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:30.047387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:30.048602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:30.126367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59be1b-27bf-498d-904c-b1955ec534da None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:30.126692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59be1b-27bf-498d-904c-b1955ec534da None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:30.126918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59be1b-27bf-498d-904c-b1955ec534da None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:30.128277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 268/543] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:28:30.134176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:30.134606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:30.134984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:30.155463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 276/544] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:30.166553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:30.167811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:30.292271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 269/545] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:30.666013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:30.845735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4a335-ae39-4a5e-ba3d-1ac1d1c05a40 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:30.894246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:30.920286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:30.920286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:30.920695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:30.921025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:30.936477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:30.944015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:30.948888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:30.949783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:30.950579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 277/546] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:30.955990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.023114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:31.110610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1fe33-5b42-4306-bcf4-9408b065a781 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.153580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980bce6-2efb-4dd7-922d-9a34e7725df8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.181856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.182684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.182970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.183248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.204256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:31.210964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:31.211946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:31.212750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:31.218498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.219349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.219845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.220309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.221181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:31.221678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:31.223557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:31.226421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 270/547] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:31.232409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.248666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 278/548] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:31.254414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.314170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:31.406892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3affc-ec6f-4279-a7c7-843613a88357 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.430361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6816-dd88-4f4d-b77f-3cd0ad181b84 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.460996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:31.472347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.473027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.473334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.473769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.486220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:31.487984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:31.505101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:31.506435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:31.507584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:31.507584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:31.507584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:31.509297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 279/549] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:31.512086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.512867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.513318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.513749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.514673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.516288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:31.518313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:31.520521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:31.536831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 271/550] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:31.545193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.666810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d440d2-9169-4b7a-a62c-36b54c1ee395 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.668176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391680e0-b1e1-493d-8a6f-be88d7edba83 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.671593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:31.707594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.708307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.708596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.708873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.714477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.715266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.715757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.716170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.716948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:31.722637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:31.722637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db0bd7-dc61-4a2c-8a76-7bf0e755c941 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:31.722820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:31.723851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:31.733662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 280/551] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:31.735270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54c3d-70b7-4354-94a5-7d416dce7bf3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.735714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54c3d-70b7-4354-94a5-7d416dce7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.736130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54c3d-70b7-4354-94a5-7d416dce7bf3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.738292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 281/552] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:31.739406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54c3d-70b7-4354-94a5-7d416dce7bf3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d26b49e4-f425-4373-820e-7a975659c47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:31.746039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:31.747212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:31.748315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:31.748315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:31.748315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:31.748315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 272/553] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:31.752925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.752925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.752925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.771797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:31.773293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:31.811287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:31.861471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54c3d-70b7-4354-94a5-7d416dce7bf3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.871423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 273/554] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:31.871423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:31.942964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:31.943996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:31.944443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:31.944857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:31.961404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:31.963208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:31.976715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caff9f-8d9b-4da0-bf80-105002a6df70 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:31.989534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:31.990677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:31.991822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:31.994189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 282/555] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:32.003903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.027078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.027745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.028033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.028311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.028975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:32.029279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.031572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.046668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 274/556] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:32.058758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.062010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.097248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.183866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e82f6-e1cf-4059-ba07-f3caf8a36355 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.194754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf21d7-0c6e-430e-9ba5-6daaa998cdf9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.224099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.225113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.225662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.225944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.226980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:32.227660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.229375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f8a5-65fd-4b30-9e04-533700566c57 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.232082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.232719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.233004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.233280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.241560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.242978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.249959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 283/557] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:32.251186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be854e40-b33e-4a8f-9c60-a6ed1626fc8e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.251554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be854e40-b33e-4a8f-9c60-a6ed1626fc8e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.251830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be854e40-b33e-4a8f-9c60-a6ed1626fc8e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.253162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 284/558] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:32.256376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:32.257808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:32.258771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:32.259312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e91a-e625-4fb4-a92e-9847bfa42fdb None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.259312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e91a-e625-4fb4-a92e-9847bfa42fdb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.259312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e91a-e625-4fb4-a92e-9847bfa42fdb None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.259312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 285/559] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:32.259312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e91a-e625-4fb4-a92e-9847bfa42fdb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.261957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 275/560] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:32.262662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.344607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.345386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.362883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a523bd-7abd-4122-a527-58df8627b781 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.364882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e91a-e625-4fb4-a92e-9847bfa42fdb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.399845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b76241-c3e8-4eff-a4a6-bf4c053d1b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.400447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76241-c3e8-4eff-a4a6-bf4c053d1b6b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.400734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76241-c3e8-4eff-a4a6-bf4c053d1b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.401111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76241-c3e8-4eff-a4a6-bf4c053d1b6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.401203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd8cad-dcb3-4eba-8afb-b0fc62316947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.401894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8cad-dcb3-4eba-8afb-b0fc62316947 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.402230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8cad-dcb3-4eba-8afb-b0fc62316947 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.402559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8cad-dcb3-4eba-8afb-b0fc62316947 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.414364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd8cad-dcb3-4eba-8afb-b0fc62316947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-edbd8cad-dcb3-4eba-8afb-b0fc62316947 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:32.419082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:32.420225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 286/561] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:32.421373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.422320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.422320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.439669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:32.440864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:32.474288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b76241-c3e8-4eff-a4a6-bf4c053d1b6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.475770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b76241-c3e8-4eff-a4a6-bf4c053d1b6b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.508586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 287/562] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:32.509606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.566469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.584919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 276/563] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:32.586414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.586699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.586976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.600254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.606223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:32.607439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:32.631668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9366b-0f16-454c-b3e8-b0136f8afd47 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.673078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.673708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.674135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.674376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.675099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:32.675422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.676902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.677584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 277/564] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:32.678254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.708972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 288/565] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:32.710463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.811697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26a17-fada-4c26-9208-fc68f99baea4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.817136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257ca71-f54e-41cb-a15a-251563afee9c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:32.824745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.847083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.847736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.848077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.848361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.849036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:32.849344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.850703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.851300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:32.857612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:32.858235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:32.858513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:32.863423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:32.864082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 278/566] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:32.864082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.876027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:32.877819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:32.893367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:32.894539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:32.896290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:32.896290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:32.896290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:32.898564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 289/567] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:32.899367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:32.985696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba59d-764f-4239-8120-d8f37a6e0bac None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.016363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8474bb-b20e-4cf3-85c7-9301cea0dd27 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.024756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.025402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.025695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.025958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.036720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.038136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:33.052610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.053563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:33.054476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:33.054476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:33.054476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:33.054648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.054746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 279/568] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.054825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.054825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.054959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.055029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.068773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:33.073897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.074828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:33.075952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 290/569] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.076663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.087236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.121651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.159353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a0cf6-aa47-4d3e-b839-1ae81c7fecd9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.179108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fddb3-a7e6-4893-a210-e832afeba32c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.196073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.196708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.196993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.197267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.208229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.209904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.215249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.215884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.216194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.216468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.217113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:33.217421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.218761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:33.225199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.226315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:33.227414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:33.227414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:33.227414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:33.227414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 280/570] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.227414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.232881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 291/571] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:33.233713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.312094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.333319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ddb35-1487-4316-a323-eba1a7e7c3c3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.336769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545368bc-c770-4eb9-9a29-a5b3e1ac806d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.338320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.368020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.368719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.369005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.369283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.372208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.372810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.373092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.373367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.374011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:33.374318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.375720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.379942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:33.384767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.385689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:33.386527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 281/572] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.387631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.387886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 292/573] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:33.388697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.487386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e0c5-fbe5-4c80-b586-aa5061e86ed0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.487842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bff7-c4d9-4913-a77a-10d559232d94 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.521010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.521611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.521887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.522156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.522274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.522807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:33.522907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.523107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.523203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.523401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.524041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:33.524348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.524485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.525728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.529424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.532702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 282/574] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:33.533466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.539420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 293/575] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:33.539420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.564713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.638538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037678f-d9c5-410f-a6ef-8cac722ac8e8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.640835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ded6-3260-4c89-805a-c6b71d2f287a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.672871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.673501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.673787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.674062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.675529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.676243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.676438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.676711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.677375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:33.677678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.679058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.681160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.682633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.687332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 294/576] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:33.688619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:33.694347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.695473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 283/577] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.696394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.757936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.781780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.797279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f1a3d-4227-41ab-9a36-5804dd58587a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.797837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d373f3e-b729-4d49-9e72-e217f2bf8578 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.831179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.831414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.831837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.831978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:33.832123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.832217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:33.832447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.832555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:33.839540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.840959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.843217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:33.844812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:33.852509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.853601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 295/578] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.859305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:33.860034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:33.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:33.862453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:33.862453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:33.862453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:33.862453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 284/579] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:33.862453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:33.965476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cb309-c9f4-4d92-97e5-b4fabac32340 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.966840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a9a5d-5ea7-4ef1-b12d-71b603ef1004 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:33.980144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:33.999359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:33.999998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.000277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.000543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.000768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.001398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.001681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.001958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.008155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.009585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.013054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.014494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:34.021316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:34.022246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 296/580] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:34.023209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.026547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:34.031067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:34.032281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:34.033594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:34.033594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:34.033594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:34.033594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 285/581] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:34.033594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.125553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c49191-f50c-4c21-bf89-c10800c8262a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.133165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced04b-db39-4588-bd5c-1fc98f019a6c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.159754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.160356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.160649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.160907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.161585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:34.161893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.163308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.167571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.168176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.168463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.168740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.169426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:34.169737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.171139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.175002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 297/582] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:34.175814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.184328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 286/583] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:34.184957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.212333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.247075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.284653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4777-29e5-4dc5-be24-50942518e87d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.288723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca1c3-96ac-48b2-bca5-940058f67db7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.323293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.323888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.324018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.324198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.324470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.324570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.324755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.325026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.325191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:34.325497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.325660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:34.326062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.326976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.327444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.341339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 298/584] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:34.341978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.349262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 287/585] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:34.350092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.444243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.450111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34269f-a4b9-46ee-911a-34ed30472bb9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.462353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab0f74-7801-4676-a969-120c3ac9ec09 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.474243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.484567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.485193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.485471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.485751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.486386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:34.486690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.488078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.496607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.497256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.497541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.497811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.498532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=ac16c8f79f7748ffa341705c05f28e8d) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:34.498844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.500275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.500754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 299/586] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:34.501542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.506139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 288/587] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/role_assignments?user.id=ac16c8f79f7748ffa341705c05f28e8d&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:34.506952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.616027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830105c-2c7d-438e-9662-1bcd03127589 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.622075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaefb1-74a9-4cbc-b34c-d15bc24a9fe7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.655927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.656605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.656885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.657159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/2c129868b68642ccab8686ed6fe22906/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.660217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.661416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.661698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.661974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.671344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.672880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.675162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=2c129868b68642ccab8686ed6fe22906, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.677566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:34.690603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:34.692231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 289/588] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:34.693345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.698609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.789547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198812e-1b73-4891-8a36-51cef85ce2cc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.799708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 300/589] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:34 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/2c129868b68642ccab8686ed6fe22906/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:34.799708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.843455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.843911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.845486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.845786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.846067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:34.860565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:34.862366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:34.886760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:34.888017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:34.888935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:34.888935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:34.888935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:34.889110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 290/590] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:34.890319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:34.942617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae568583-b893-41ea-9c7a-73ab4d7260db None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:34.980374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:34.987460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:34.989010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:34.989578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:34.990003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.005348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.007789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:35.024143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:35.025864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 14:28:35.027415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:35.028706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 301/591] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:35.030340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.043408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d797-9389-4df2-a54d-dd02efcc37fd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.088936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.089917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.090209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.090487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.091221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:35.091581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.093612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.118975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 291/592] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Sep 7 14:28:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:35.119956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.162437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:35.178025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824ea1d-2094-4209-ba20-97a08f4d7190 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.228977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.230329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.231127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.231658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.233227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:35.234004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.235621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.235751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bf868-af45-4e2e-99b9-d43370ced9cd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.255816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:35.264095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 302/593] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:35.264806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.282062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.282350 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.282851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.284094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:35.284911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.287218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.307436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 292/594] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:35.308377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.401916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafe89e-ab5f-4af5-922b-ff8ff5063697 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.419319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797d2b8-3dee-45ab-8120-03587fe86389 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.443907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.444973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.445502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.445975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.457259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.457711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.458567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.458922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.459272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.459927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.466905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.468447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:35.477035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:35.477993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:35.478884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:35.478884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:35.478884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:35.480981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 303/595] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:35.481733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:35.482591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:35.484140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 293/596] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:35.489348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.490005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.499776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:35.525853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:35.601577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953276a3-62a8-4e5b-ae53-653588d14cb1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.604284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cffcdb-fbff-4336-b5d4-c6269057d6ea None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.640128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.640729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.641016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.641290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.641935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:35.642245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.642961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.643633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.644086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.644556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.645433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.657441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.659201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.663888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 294/597] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:35.664827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:35.679352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:35.680808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:35.681716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:35.681716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:35.681716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:35.684091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 304/598] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:35.685323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.755922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:35.799809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:35.803923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10ebb-0655-4d09-bb44-ddf340cfc6c2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.816568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006193-a0ae-4e12-9212-0531010a7f7b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:35.842684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.843731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.844286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.844779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.845678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:35.846216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.847940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.860197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:35.860826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:35.861104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:35.861376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:35.868043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 295/599] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:35.869241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:35.869490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:35.871003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:35.886251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:35.887187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 305/600] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:35.888136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:36.007466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c8934-52f4-496e-bd73-6efbc3c74281 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.012178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c13f8-beae-41af-bba6-014c14c08397 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.031735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:36.047406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.050525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.050525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.050525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.050525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:36.050525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.051559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.051902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.052328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.052492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.052885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/95f7c352378a4bc08f1d1acddae20cac/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.066050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 296/601] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:36.067956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:36.070975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=95f7c352378a4bc08f1d1acddae20cac, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.072619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.084929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:36.156106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 306/602] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:35 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/95f7c352378a4bc08f1d1acddae20cac/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:36.158003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:36.211572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01a86-4e24-4360-94bb-a5cf9a94a940 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.286502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.288105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.288398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.288675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.289393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:36.289705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.292008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.323260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 297/603] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:36.327308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:36.385378 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f63f8-28fe-4f28-899e-edd3c0a4b212 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.428373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.429435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.429976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.430454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.440829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.442637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.449836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:36.455937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:36.456857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:36.458298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:36.461213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 307/604] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:36.472352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:36.481572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59fdad-1818-41b4-861c-fbc857bb2fbd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.525049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.526092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.527182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.527797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/b3493b21604b404391be7b8909461d75/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.530464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:36.562554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=b3493b21604b404391be7b8909461d75, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.564007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.624966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d06b82-5723-4d6d-a328-a4021a0c1152 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.664650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 298/605] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:36 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/b3493b21604b404391be7b8909461d75/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:28:36.673253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.673931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.674211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.674480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.675175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:36.675505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.677800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985ad9a-f481-40ff-8631-ade9a01f1130 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.697214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 308/606] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:36.704051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:36.836470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafdd40-e95f-4954-8587-7e0d3a3c076b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:36.863085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:36.875536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73cdc-cfb2-4907-995d-ae5df4a24a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:36.876230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73cdc-cfb2-4907-995d-ae5df4a24a9e None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.876517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73cdc-cfb2-4907-995d-ae5df4a24a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.876797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73cdc-cfb2-4907-995d-ae5df4a24a9e None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/3c333a75ebd74779acf201947470a92e/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.895633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73cdc-cfb2-4907-995d-ae5df4a24a9e None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=3c333a75ebd74779acf201947470a92e, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:36.897151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73cdc-cfb2-4907-995d-ae5df4a24a9e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:36.916387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440b60-7725-4097-bbdc-ea99f14aea5e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.916726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440b60-7725-4097-bbdc-ea99f14aea5e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.916941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3440b60-7725-4097-bbdc-ea99f14aea5e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.927556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 309/607] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:36.933820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2aa2-e95a-4319-bd35-bbbd048bea1d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:36.934102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2aa2-e95a-4319-bd35-bbbd048bea1d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:36.934379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2aa2-e95a-4319-bd35-bbbd048bea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:36.954542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-98ca2aa2-e95a-4319-bd35-bbbd048bea1d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:36.955776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-98ca2aa2-e95a-4319-bd35-bbbd048bea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:36.968800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 299/608] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:36 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/3c333a75ebd74779acf201947470a92e/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:37.049386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 310/609] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:37.204921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f54f-15c7-43aa-b133-880506cf72db None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:37.205422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f54f-15c7-43aa-b133-880506cf72db None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:37.205502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f54f-15c7-43aa-b133-880506cf72db None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:37.207113 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 300/610] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:37.213564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:37.213865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:37.214133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:37.233824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:37.235028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:37.251346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:37.317758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 311/611] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:37.421987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f54f-15c7-43aa-b133-880506cf72db None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:37.551615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f54f-15c7-43aa-b133-880506cf72db None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:37.588404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:37.589096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:37.589384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:37.589662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:37.600958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:37.605892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:37.606878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:37.607755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 301/612] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:37.612728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:37.721695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:37.761285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cf831-5ca2-413f-9b1b-095b13cfec28 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:37.776625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:37.813561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:37.814094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:37.814383 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:37.814657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:37.815356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:37.815665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:37.817639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:37.838735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 312/613] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:37.844095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:37.862070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a289b-a24c-4238-bec3-681ca6be5dcf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:37.871939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:37.901875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:37.902908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:37.903502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:37.904026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:37.930353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:37.936304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:37.937249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:37.938133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:37.945657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 302/614] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:37.948013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.068421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:38.074804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a83ea1-60af-459a-9e22-ffeb3d8bd4e9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.091605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fd14-f6b0-470e-ba1b-e685ac7bf568 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.128111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.128744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.129204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.129489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.130342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:38.130644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.130934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.131872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.132089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.132553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.133027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.145447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.147221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.151348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 303/615] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:38.168016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:38.169046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:38.169970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:38.169970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:38.169970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:38.170153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.172469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 313/616] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:38.178115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.256119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:38.291310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b931ba-336f-4b75-9f2b-da719bfb75d0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.333719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.335444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.335941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.336485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.337341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:38.338051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.339905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.353777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fecea4-a2fe-47f6-9edf-27a647206dc6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.355584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 314/617] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:38.360588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.418406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.419044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.419323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.419625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.445610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.447049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.475608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa7ec-900b-46cb-b4f6-9134591035be None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:38.482470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:38.483674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:38.488575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:38.488575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:38.488575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:38.488575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 304/618] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:38.508489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.522611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.523768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.524304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.524885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.532976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.534706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.537914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:38.539708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:38.552745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:38.555891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:38.556874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 315/619] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:38.560436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.702328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9a5af-d5c6-4be7-b5e1-36e1d369f6fb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.743515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.744129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.744415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.744695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.745431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:38.745742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.747181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.766076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d432e19-b444-43ba-9731-ccd25d1c8aba None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.767506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 316/620] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:38.773291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.835843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.836640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.836932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.837210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.837864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:38.838170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.839627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a818eb1-f89d-4681-975d-5e49b0920b61 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:38.842414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:38.859483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 305/621] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:38.861078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68043550-698e-4bda-a458-3500e7e45da3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.861710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68043550-698e-4bda-a458-3500e7e45da3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.863962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68043550-698e-4bda-a458-3500e7e45da3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.869823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 306/622] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:38.871316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68043550-698e-4bda-a458-3500e7e45da3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:38.920069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dba3f-f9eb-41c6-a3d9-a0e4e21457f9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:38.962105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:38.962670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:38.962952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:38.963288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:38.967854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:38.975228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:38.976883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d617bd56-6c74-4645-9a86-3c2c41f21fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:39.001548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:39.002546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:39.004677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:39.004677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:39.004677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:39.011002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 317/623] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:39.011002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.011002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.011002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.026180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68043550-698e-4bda-a458-3500e7e45da3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.032689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:39.033940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:39.071223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.072303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.072987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.073906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.086250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.088314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:39.110374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:39.111447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:39.112388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:39.116504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 307/624] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:28:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:39.117674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.142735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 318/625] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:39.142735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.189455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:39.312033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5dd9d-e20a-4110-821f-1374282d4073 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.331685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a25e5-9351-409a-b8f7-d581c226d47f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.373206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:39.374244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.374863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.375144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.375471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.376259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:39.376571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.378014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.395723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.397866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.398387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.398865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.399779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:39.400296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.406194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.423417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 319/626] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:39.423417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.435861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 308/627] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:39.443259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.538828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:39.560863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b72b0-ecda-48e1-bc7d-bdd8e2690c10 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.606233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460018b-3c8a-4476-8f6c-3d15bf8531ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.606756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460018b-3c8a-4476-8f6c-3d15bf8531ab None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.607034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460018b-3c8a-4476-8f6c-3d15bf8531ab None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.607202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9610-895d-4bba-99eb-d5d46286e1d5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.607304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460018b-3c8a-4476-8f6c-3d15bf8531ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.645200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.645821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.646100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.646368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.653090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.654507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:39.666038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:39.667141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 309/628] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:39.668603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.683973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460018b-3c8a-4476-8f6c-3d15bf8531ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.685433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460018b-3c8a-4476-8f6c-3d15bf8531ab None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.721244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:39.767595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:39.773631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59152-5b43-42e7-b246-bfafa56ebad9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.787569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 320/629] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 14:28:39.789077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3bcc-75ee-4af8-9dda-b17acef6ea21 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.789381 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3bcc-75ee-4af8-9dda-b17acef6ea21 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.789660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3bcc-75ee-4af8-9dda-b17acef6ea21 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.790898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 321/630] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:39.792139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2510-fbd9-4db8-8b88-4464b72c6c70 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.792264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2510-fbd9-4db8-8b88-4464b72c6c70 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.792557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2510-fbd9-4db8-8b88-4464b72c6c70 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.793645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 322/631] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:39.794361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee2510-fbd9-4db8-8b88-4464b72c6c70 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.815684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.816322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.817233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.817513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.827606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:39.832891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:39.834007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 310/632] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:39.834877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:39.895119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee2510-fbd9-4db8-8b88-4464b72c6c70 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.937298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.937445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3050b-a3f2-4aac-9a02-6c197cf2bdb3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:39.937901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.938180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.938454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.939148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:39.939484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.940919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fd64-943f-47d1-a172-a0de11c648f5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:39.946328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:39.952554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 323/633] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:39.953755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.954038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.954308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.972320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:39.973463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:39.973571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:39.973828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:39.974093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:39.974750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:39.986244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:39.987763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f680b065-8246-4a2c-a8e7-34996acf98d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:40.002219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:40.003436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:40.004913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:40.004913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:40.004913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:40.004913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 311/634] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:40.004913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.004913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.005257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.016130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.022928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:40.024450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:40.056481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 324/635] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:40.057650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.103450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 312/636] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:40.103450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.164206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837687d-2a5c-4593-a514-dd9a84781b7a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.200462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.201229 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.201724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.201970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.202724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:40.203121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.204608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.218749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 325/637] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:40.219768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.220901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.233185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14431bf4-8eea-4cbd-8a90-2b0e0b6870f0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.274023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.274848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.275224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.275632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/ac16c8f79f7748ffa341705c05f28e8d/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.275742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.291995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=ac16c8f79f7748ffa341705c05f28e8d, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.293496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.341859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e3fca-8761-4aa8-8d66-59ba201824e0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.366755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 313/638] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:40 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/ac16c8f79f7748ffa341705c05f28e8d/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:40.367907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.382492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.383120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.383441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.383710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.384380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:40.384689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.386116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.403827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 326/639] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:40.403827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.506569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432490c9-00aa-41a5-aa09-a714b2658fca None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.518187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.530119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676f3c7-ef99-4a78-8b6c-5f7f49ccc24d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.546641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.547284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.547894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.547894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.557506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.560381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.561843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.576904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.577543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.577824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.578099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:40.578211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:40.579193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:40.580212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:40.580212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:40.580212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:40.580212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 314/640] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:40.580212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.595691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:40.601121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:40.602069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:40.602922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 327/641] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:40.604302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.698173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ade4b-a0af-4aea-ba86-b9936f817843 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.718254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3b6cd-3691-4c1e-8f21-4a0a2f993736 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.734266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.734911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.735195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.735504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.746732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:40.752106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:40.753163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:40.754582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:40.758928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 315/642] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:40.759695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.767306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.767992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.768518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.768518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.778788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.780746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:40.795165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:40.796293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 328/643] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:40.797893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.813810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.822590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:40.871549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3af8c-f525-4a34-a695-175e3cd91ad1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.906225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a406-9315-433b-89c5-f7a28266900a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:40.909898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.911072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.911454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.911738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.912376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:40.912679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.914461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.935947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 316/644] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:40.935947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:40.954206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:40.954609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:40.954893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:40.955169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:40.955871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:40.956163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:40.958059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:40.967665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 329/645] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:40.972293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.039052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4d2e-8428-489d-b07f-657ce455cae3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.054908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.066128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.083758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.084930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.085478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.086412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.087133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:41.087471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.088838 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.094336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4c1d-7e0f-4b2a-bf77-67f729c0ca76 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.097268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 317/646] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:41.099061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.140676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.141281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.141559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.141829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.142513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:41.142817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.145073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.158231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 330/647] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:41.159811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.211619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4564e8f-458f-48a8-80ee-0a5b08ebf5bc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.252734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.253382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.253664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.254123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.264216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.265806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:41.278850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:41.280095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:28:41.281423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:41.282021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b6cb2-26f9-4df8-bf88-e444d1da739a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.284681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 318/648] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:41.285470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.319648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.320253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.320892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.321428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.321707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.324429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.334978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.337210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:41.354503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:41.355654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:41.356846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:41.356846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:41.356846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:41.356846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 331/649] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:41.357113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.395520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea99a-b8e8-4ffe-a1db-e97d0d21ac9b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.432490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.433111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.433392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.433661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.445663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.447460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:41.464252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:41.465238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:41.466165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:41.466165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:41.466165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:41.466165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 319/650] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:41.466165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.474935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25518-dcd8-4c74-bc07-0042dcc25920 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.513566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.514175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.514457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.514731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.515492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=2c129868b68642ccab8686ed6fe22906) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:41.515806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.517238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.535431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 332/651] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/role_assignments?user.id=2c129868b68642ccab8686ed6fe22906&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:41.535431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.581429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.603237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c93c7-60f4-4491-a582-3878874a0c2d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.606734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.652745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.653808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.654322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.654959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.655979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:41.656526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.658311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.668542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b88eb-174e-4536-9a7d-dc1e3171ee70 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.681118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 320/652] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:41.682370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.716398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.717017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.717289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.717563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.718206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:41.718510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.720016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.739401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 333/653] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:41.739401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.811078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5b0c8-b9b1-4417-9e8b-58ca6c57464d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.858327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.859304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.859817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.860296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.861167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:41.861689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.863845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.871770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030ad39-0f49-4e46-a57b-032e446142d2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:41.877412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 321/654] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:41.878484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:41.884657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.887481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:41.911047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:41.911730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:41.912003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:41.912319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:41.983994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:41.985501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:41.999483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9641-118b-4394-9a9d-eebae05e1fe5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.036983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.038038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.038530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.039014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.047849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.049546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:42.062069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:42.063093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 14:28:42.064428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:42.071180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 322/655] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:42.072318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.090690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 334/656] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:42.095939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.116285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.152550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.202843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5ea0-ff4c-4d43-a029-c9094af4a655 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.217538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a99aa2-4d46-4714-81cd-e0b96d414d5c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.247270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.248352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.248843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.249345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.256057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.256739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.257018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.257291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.258092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:42.258402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.260454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.260570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.262301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:42.276014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:42.277032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 14:28:42.277995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:42.279471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 335/657] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:42.280292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.286050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 323/658] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:42.287312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.350852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.386560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af33de-6cc6-44ad-88bf-621723c0664a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.403327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e93294-69f9-41d7-99d0-f156366a2246 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.423333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.423985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.424263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.424530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.433398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.435766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.437372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.446549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b9997-52f6-452c-a1d0-6cb0996877f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.447541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9997-52f6-452c-a1d0-6cb0996877f7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.447998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9997-52f6-452c-a1d0-6cb0996877f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.448583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9997-52f6-452c-a1d0-6cb0996877f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:42.453764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:42.454908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:42.456099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:42.456099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:42.456099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:42.458077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 336/659] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:42.464038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.535290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b9997-52f6-452c-a1d0-6cb0996877f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.537272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b9997-52f6-452c-a1d0-6cb0996877f7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.572097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db2ac-4d99-4949-9a35-fa813f71db9a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.596095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.610622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.611332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.611746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.611977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.612703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:42.613002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.615235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.635782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 337/660] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:42.635782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.654250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 324/661] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:42.655476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536030-36a2-4752-8d95-730017776f10 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.655765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536030-36a2-4752-8d95-730017776f10 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.656044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536030-36a2-4752-8d95-730017776f10 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.657268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 325/662] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:42.657959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536030-36a2-4752-8d95-730017776f10 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.684880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.760465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b07d6a-0613-4536-8522-4e5c0f1df2ac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.765482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536030-36a2-4752-8d95-730017776f10 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.800011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.800637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.800922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.801195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.801837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:42.802028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.802144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.802631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.802930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.803395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.803501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.820789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 338/663] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:42.820789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:42.859340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.883303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.884780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.914114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:42.931364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a62c2-172e-471a-9119-425f737fc786 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:42.970224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:42.970856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:42.971133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:42.971498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:42.982149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:42.983638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d4df4921-935d-4eaf-917f-085dafb6330d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:42.997938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:42.998928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:42.999887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:42.999887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:42.999887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:42.999887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 339/664] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:43.000401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.000542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.000817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.020111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 326/665] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:43.021419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.024269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:43.025681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:43.104911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 340/666] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:43.106645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.130834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6176e-0f15-429a-be60-77e983169141 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.146582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.163233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.174407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.174720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.175010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.175287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.183654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.184899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:43.197285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:43.202180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:43.203578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 327/667] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:43.204195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.253523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45847-00c4-4ef1-8e42-8e0f7c4e6f18 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.292579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.293717 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.293717 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.293919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.294506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:43.294820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.296347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.314576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 341/668] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:43.315509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.330504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fb9fa-5d52-434a-ba31-4484453e726e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.374221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.375106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.375568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.375992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.390537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.393205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.407112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:43.409425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:43.411144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:43.412300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:43.412300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:43.412300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:43.412300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 328/669] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:43.412300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.435838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2b04-cb4c-4f26-9705-95dc037aabe1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.451653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.475816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.476549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.476892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.477239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.477931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:43.478238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.479686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.498268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 342/670] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:43.498268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.526951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e439d-8bdf-4f63-bc67-3504c3ff6723 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.566879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.567544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.568305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.568585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.579507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.580975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:43.593456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:43.594420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 329/671] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:43.595346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.608628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe47466-64e7-47c8-8d22-8965bb847dbd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.648289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.648919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.649198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.649508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.657302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.660884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:43.665662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:43.668581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 343/672] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:43.669438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.704301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.710743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81261927-fa2b-401a-8dcb-8aa8cc6cfb1b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.753034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.754423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.754869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.755361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.756093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:43.756404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.757837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.775952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 330/673] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:43.775952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.788573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fc45e-4bdc-4a7d-9e59-11ea6e0f6660 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.828419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.829021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.829322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.829578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.830297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=95f7c352378a4bc08f1d1acddae20cac) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:43.830610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.832151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.839100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 344/674] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/role_assignments?user.id=95f7c352378a4bc08f1d1acddae20cac&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:43.840041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.903336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eb03a-e271-4c46-96df-68bd4cf72e6b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.922029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:43.949859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:43.950484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:43.950764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:43.951081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:43.951777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:43.952486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:43.953538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:43.972851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 331/675] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:43.973037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc9161-b419-40d0-9112-d13f1044488e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:43.973649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:43.993920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:44.012818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.013439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.013715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.013986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.014662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:44.015065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.016390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b2488-b3f1-426f-b25b-fdd5577c7b83 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.025703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 345/676] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:44.027152 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7ce6-580f-4e9a-a4ad-acb33defb23d None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.027478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7ce6-580f-4e9a-a4ad-acb33defb23d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.027824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc7ce6-580f-4e9a-a4ad-acb33defb23d None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.029313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 346/677] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:44.030017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc7ce6-580f-4e9a-a4ad-acb33defb23d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.098529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ee6d-2aa1-487c-9a25-aa729f5fb0fc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.135454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.136332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.136446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.136676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.143656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.145534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.147465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc7ce6-580f-4e9a-a4ad-acb33defb23d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:44.157162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:44.158112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:44.159012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 332/678] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:44.159555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.179269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:44.192470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.193208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.193689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.194128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.194619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=b3493b21604b404391be7b8909461d75) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:44.194922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.196372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662c01d-a725-43f9-99d0-b856f361fe22 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.202836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 347/679] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/role_assignments?user.id=b3493b21604b404391be7b8909461d75&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:44.212926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.213617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.214094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.240714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:44.243159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:44.263481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:44.294778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dae716-034a-46bd-a728-84bab7101ef8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.340995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.341767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.342059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.342339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.361202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.361202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.361510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 348/680] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:44.361510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:44.386110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:44.387137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:44.388116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:44.388116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:44.388116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:44.391533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 333/681] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:44.401840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.509361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5c0fc-0a50-4b5c-9618-146c5bc10de1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.540236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:44.548149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f34c1-e97d-46b7-bc46-c1343a5e5b76 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.575976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.576593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.576873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.577144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.578433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:44.578745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.580395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.594830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 349/682] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:44.601815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.612755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:44.628922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.629569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.629851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.630129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.630822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:44.631129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.632859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.658134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 334/683] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:44.664363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.734045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a69af-9380-4797-94d4-be29f60de866 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.782861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.784035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.784747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.785881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.787707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=3c333a75ebd74779acf201947470a92e) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:44.788598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.790323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1c6d-5ec2-4227-a6b9-62721d566d36 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.790875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.799621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 350/684] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/role_assignments?user.id=3c333a75ebd74779acf201947470a92e&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:44.801011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.891455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:44.901031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.901761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.904304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.904304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:44.922373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:44.923971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:44.938513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068b0e1-8729-4224-8b90-461bdc08bb9e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:44.950873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:44.951937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:44.952900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:44.956480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 335/685] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:44.964020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:44.980728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:44.981957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:44.982247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:44.982528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.006824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:45.018930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:45.020722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:45.021565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 351/686] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:45.027170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.063393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:45.121275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45620-25ee-4bce-8d50-bc234033d684 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.185035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.186195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.186723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.187003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.187792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:45.188111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.188459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409a57-0cf0-4a98-bce7-125b61b5ee71 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.189615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.192986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:45.221646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 336/687] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Sep 7 14:28:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:45.224106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.229284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.230087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.230377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.230648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.231315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:45.231668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.233042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.242541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 352/688] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:45.248242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.366059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f3fe5-b08d-47c9-a0c5-974d408e807a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.377254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:45.384643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829842-fc1d-4c62-bd8a-951cde1c3079 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.421279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.422336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.422691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.423109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.426544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.428294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.430135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.430639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.446255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.448311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:45.468228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:45.469216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:45.470110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:45.470110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:45.470110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:45.472761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 353/689] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:45.483397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.517481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:45.529692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.531337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.674786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594898-c289-4ac2-9af0-6cf4722c1c2d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.718698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 337/690] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 14:28:45.724605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.734783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:45.750069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.750963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.751420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.751847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.753114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:45.753666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.755627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.782657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 354/691] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:45.783424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.883747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:45.890597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbed9d-d7d2-49d8-92d8-18e8e5fe6936 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.905561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05105-d5ed-4d74-b154-51129b76a8b5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:45.937173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.937895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.938255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.938608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.943662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:45.944294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:45.944579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:45.944855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:45.950659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.952256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.952481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:45.954025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:45.966334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:45.967302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:45.968291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 355/692] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:45.973695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:45.982339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:45.983332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:45.984316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:45.984316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:45.984316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:45.984316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 338/693] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:45.989338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.081205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577ce5f-38c4-467d-9b92-36f9e3c0fb35 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.117765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:46.118372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.118651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.118923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.119691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:46.119999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:46.121440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:46.131806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:46.140762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 356/694] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:46.142318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:46.146659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.232201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f604e-62fb-4752-9d0b-8d489ad13107 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.253420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8aa3e-48d4-465e-b33e-d07d05844608 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.289650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:46.290266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.290546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.290822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.356893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:46.357535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.357822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.358101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.358781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:46.359088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:46.360562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:46.361124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:46.369430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:46.371011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:46.395895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 339/695] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:46.401272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.478729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 357/696] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 14:28:46.484231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.564428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4394-b215-46ee-8ebc-2a65315b5f75 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.583067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:46.601003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:46.601784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.602174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.602557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.613748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:46.615201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-3cc77548-0eb0-49ff-9a57-ea95856a27c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:46.636152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:46.637201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:46.638191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:46.640999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:46.642961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 340/697] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:46.644781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02e413-c5e9-466a-af1b-481819f3c07f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.645834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02e413-c5e9-466a-af1b-481819f3c07f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.646432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02e413-c5e9-466a-af1b-481819f3c07f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.651443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977a25-4b80-4419-af5b-93024c12fe26 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.651912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 341/698] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:46.653038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02e413-c5e9-466a-af1b-481819f3c07f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.697856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:46.699170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.699748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.700307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.714922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:46.717077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-cb65e0c8-a3dc-4493-9a3b-dc77a97061bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:46.748434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:46.749465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:46.750383 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:46.750383 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:46.750383 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:46.759938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 358/699] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:46.759938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.759938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.759938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.781065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:46.782357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:46.782998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02e413-c5e9-466a-af1b-481819f3c07f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.822372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:46.823081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.823368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.823672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.824369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:46.824683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:46.826115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bde95c-598b-4d47-82e4-a0c6556e2787 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:46.839405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 342/700] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:46.840512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aade13-22b8-4c2f-9326-d7e86d36ccfb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:46.840807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aade13-22b8-4c2f-9326-d7e86d36ccfb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:46.841089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aade13-22b8-4c2f-9326-d7e86d36ccfb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:46.846685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 343/701] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:46.846685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aade13-22b8-4c2f-9326-d7e86d36ccfb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.866351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 359/702] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:46.867114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:46.891656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:46.969792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aade13-22b8-4c2f-9326-d7e86d36ccfb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:46.982401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.011254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689812bf-9104-465e-b0ec-caaeceb8a10e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.015247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.015984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.016380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.016751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.017638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:47.018036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.020218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855b58a-1fbf-4e43-80f5-a8c713d4a57a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.041336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 344/703] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:47.041336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.041336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.041336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.061119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.061954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.062487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.062913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.063301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:47.063999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=ac16c8f79f7748ffa341705c05f28e8d) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:47.064461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.064868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:47.066795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.079107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 360/704] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:46 2022] GET /identity/v3/role_assignments?user.id=ac16c8f79f7748ffa341705c05f28e8d&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:47.080520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.182537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 345/705] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:47.184291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.222177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.264064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14115a6-dcc3-48fb-a6ee-7c494c907938 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.334139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.334935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.335520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.335796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.346304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.348903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.357940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5edcb-f23f-415b-ab46-208582d8d003 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:47.366189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:47.367131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:47.368077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 361/706] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:47.374608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.380065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.401797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.402712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.403002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.403272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.404057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.406086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:47.421380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:47.423780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:47.425865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 346/707] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:47.435460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.500721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82f4c-5d8c-46df-b6d6-6310f4c38815 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.547703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.549119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.549249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.549765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.550600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.551316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:47.551661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.553779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.559338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ebca0-830e-4218-b434-95dd4b9578f6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.565545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 362/708] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:47.566910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.598512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.599500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.600210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.601702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.601702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:47.601885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.604264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.612125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 347/709] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:47.612125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.650670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.700012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20b9a-9747-4756-b9a2-ba5fd8d8a3f4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.739589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.740259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.740538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.740809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.741460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.741566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e99cb-7038-4c07-b5ab-4fcf3be46207 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.742971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:47.755830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:47.756899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:47.757735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 363/710] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:47.758536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.785359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.786072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.786360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.786690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.787528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=2c129868b68642ccab8686ed6fe22906) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:47.787854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.789402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.796052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 348/711] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/role_assignments?user.id=2c129868b68642ccab8686ed6fe22906&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:47.796980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:47.830556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.912766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f63d1-c5fd-4c16-a1e2-55d9122b01d4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.934685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7166580-0999-4f30-a369-e74a4abd82a7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:47.947861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:47.957497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:47.958387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.958678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.958974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.959622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:47.959933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:47.961645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171ab95-0844-4d4f-b7ce-edd5e49835e1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:47.975592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 364/712] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:47.975592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7140971-5b78-4d8c-aa32-47dfd93327e4 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.975592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7140971-5b78-4d8c-aa32-47dfd93327e4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.975592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7140971-5b78-4d8c-aa32-47dfd93327e4 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:47.975592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 365/713] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:47.977596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647eed-4416-49b9-8087-a8227157929b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:47.977882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647eed-4416-49b9-8087-a8227157929b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:47.978156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647eed-4416-49b9-8087-a8227157929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:48.004356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:48.004984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:48.005268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:48.005546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:48.006209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] RBAC: Adding query filter params (name=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:48.006502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:48.007959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:48.008662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4c647eed-4416-49b9-8087-a8227157929b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:48.010767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4c647eed-4416-49b9-8087-a8227157929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:48.013515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 349/714] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:28:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:48.019978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:48.168943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 366/715] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:48.169116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:48.191767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437ca1-4a3d-4492-9926-fa279fce613e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:48.230971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:48.232013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:48.232519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:48.232988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:48.233820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:48.234318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:48.235896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:48.243218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 350/716] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:28:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:48.537180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647eed-4416-49b9-8087-a8227157929b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:48.662692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647eed-4416-49b9-8087-a8227157929b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:48.684522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:48.698897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:48.699564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:48.699846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:48.700119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:48.715411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:48.716867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:48.735409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:48.737371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:48.738982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:48.738982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:48.738982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:48.738982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 367/717] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:48.743463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:48.868208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc23b-5013-47d3-8369-cba79eb920b9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:48.918662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:48.918662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:48.918662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:48.918662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:48.919080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:48.919080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:48.919995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f92406-c4d8-4c0f-9b95-85d345dbcf99 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:48.940427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 351/718] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:48.946407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:49.079720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc0082-b75f-441d-9d92-40a38d54df6d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:49.123118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e0532-44fa-49e5-8a44-2cd712387360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:49.123683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0532-44fa-49e5-8a44-2cd712387360 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:49.123964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0532-44fa-49e5-8a44-2cd712387360 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:49.124234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e0532-44fa-49e5-8a44-2cd712387360 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:49.124949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e0532-44fa-49e5-8a44-2cd712387360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:49.126438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e0532-44fa-49e5-8a44-2cd712387360 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:49.215849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 368/719] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:28:48 2022] POST /identity/v3/users => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:49.876108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a238064-9849-4b17-b234-e205a6a9f84c None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:49.876541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a238064-9849-4b17-b234-e205a6a9f84c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:49.876738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a238064-9849-4b17-b234-e205a6a9f84c None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:49.878283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 352/720] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:49.883967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82768dd-4244-42ea-bb1b-b722f2f81551 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:49.884440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82768dd-4244-42ea-bb1b-b722f2f81551 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:49.884528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82768dd-4244-42ea-bb1b-b722f2f81551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:49.907523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a82768dd-4244-42ea-bb1b-b722f2f81551 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:49.908720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a82768dd-4244-42ea-bb1b-b722f2f81551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:49.958746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:50.020005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 369/721] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:50.308240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a238064-9849-4b17-b234-e205a6a9f84c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:50.325553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:50.449077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a238064-9849-4b17-b234-e205a6a9f84c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:50.469203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438198-4bc4-4e5a-9238-da4103cb4821 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.469862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438198-4bc4-4e5a-9238-da4103cb4821 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.470335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438198-4bc4-4e5a-9238-da4103cb4821 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.472701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 370/722] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:50.478149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.478711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.479183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.498942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:50.500563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:50.504632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:50.505287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.505579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.505860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.526544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:50.531825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:50.532773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:50.533624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 353/723] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:50.538942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:50.601366 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 371/724] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:50.627120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:50.668764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdce58-1dff-4a7a-9076-fc8376d7bc2a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:50.704859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:50.705857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.706338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.707364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.708398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:50.708902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:50.710756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5a89-11b7-49be-97a2-4403f9143393 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:50.720544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 354/725] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:50.726024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:50.857462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:50.870329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98035-ba36-4df1-ac7a-15d1869f1f7f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:50.906684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1c05e-9989-4c27-9d7b-081e2fe0828b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.907297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1c05e-9989-4c27-9d7b-081e2fe0828b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.907944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1c05e-9989-4c27-9d7b-081e2fe0828b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.909876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 355/726] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:50.915167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.915488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.915770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.929550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:50.929912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:50.930128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:50.930405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:50.946991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:50.948759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:50.964494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:50.965979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:50.991713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:50.992765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:50.993673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:50.993673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:50.993673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:50.997528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 372/727] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:50.998421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.027557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 356/728] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 14:28:51.028859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.136085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:51.177867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59ae63-83db-4f41-9dd1-9099ba0cbd80 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.198299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf945f0-c9cc-44ad-9436-3091448f67e1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.225008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8646e5-1407-4d4c-b750-07e10cff5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.225665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8646e5-1407-4d4c-b750-07e10cff5d45 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.225942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8646e5-1407-4d4c-b750-07e10cff5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.226212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8646e5-1407-4d4c-b750-07e10cff5d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.236391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:51.240239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8646e5-1407-4d4c-b750-07e10cff5d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ee8646e5-1407-4d4c-b750-07e10cff5d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:51.245877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:51.251487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 373/729] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:51.252405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5412e-82d4-42eb-b25d-e94b478c7a81 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.253194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5412e-82d4-42eb-b25d-e94b478c7a81 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.255408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5412e-82d4-42eb-b25d-e94b478c7a81 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.257182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 374/730] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:51.258025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5412e-82d4-42eb-b25d-e94b478c7a81 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.379545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5412e-82d4-42eb-b25d-e94b478c7a81 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.381862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.382562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.382906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.383240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.383934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:51.384238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:51.385579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f093e-3db0-4a8a-b663-e47b50d139bb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:51.402405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 357/731] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:51.402405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.402405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.402405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.417625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:51.418801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:51.423979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.424583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.424863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.425136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.426583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:51.427123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:51.428422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:51.441833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 375/732] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:51.441833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.493630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 358/733] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 14:28:51.494619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.517543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:51.557255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:51.571015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a6f73-fc49-4bee-8baf-83c34bde18f4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.614182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3111f9-4053-4c1b-b5e6-ba0a22c948c9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.618827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.619728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.620226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.620695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.621553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:51.623675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:51.654354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.655563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.656120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.656709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.669666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:51.671160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:51.683780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:51.684821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 359/734] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:51.694798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.727544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 376/735] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:28:51 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:51.728804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.836111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54702-fa21-4d61-9c2b-d3e0623b69b5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.855214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:51.886651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037abf87-974c-494d-8ad9-7cfc16c8ecfd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:51.896766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.897832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.898330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.898847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.910535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:51.912831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:51.914572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:51.932091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:51.933429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:51.933920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:51.934400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:51.935339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:51.935877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:51.937034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:51.937975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:51.939014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:51.939014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:51.939014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:51.939014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 360/736] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:51.939243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:51.940617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:51.965705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 377/737] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Sep 7 14:28:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:51.966618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.091534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73898eb3-8781-4fa1-aee2-700227fbdf1a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.096941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c28a-a207-456f-a0b0-7a20d2636149 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.132155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.132813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.133107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.133380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.134037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.135417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.139801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.140409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.140688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.140958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.141700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:52.142005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.143354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.155738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 378/738] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:52.159493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.197040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:52.239199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 361/739] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:28:51 2022] POST /identity/v3/services => generated 240 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:28:52.240038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.269985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:52.281727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f4ddc-4459-4e87-83c6-4f1c9c458980 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.349931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f40d83-6833-41bd-ba9d-2266123234f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.350986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40d83-6833-41bd-ba9d-2266123234f8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.351262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40d83-6833-41bd-ba9d-2266123234f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.351569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40d83-6833-41bd-ba9d-2266123234f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.371273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc9e12-8f57-4730-b798-757381d09090 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.415436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.415436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.415436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.415436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.423893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.425893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-31980087-140a-4fe8-960d-4e5f97b7ad82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:52.438929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:52.440021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:52.441213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 362/740] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:52.442401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d45c-6cae-480a-94f0-ba81c1534053 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.447485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d45c-6cae-480a-94f0-ba81c1534053 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.447485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d45c-6cae-480a-94f0-ba81c1534053 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.447785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 363/741] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:52.448482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560d45c-6cae-480a-94f0-ba81c1534053 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.449610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f40d83-6833-41bd-ba9d-2266123234f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.451102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f40d83-6833-41bd-ba9d-2266123234f8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.491039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:52.565589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:52.582827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 379/742] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:28:52.582827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.582827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.582827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.599857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:52.600180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560d45c-6cae-480a-94f0-ba81c1534053 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.601066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:52.644042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.645862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.646315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.646739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.647662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:52.648119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.649686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.679620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 364/743] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:52.679620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.688793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 380/744] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:28:52.690013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.771467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:52.798115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d8fb-dedc-4a2c-af8f-4e1e27ffb828 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.823428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa8c3-c41a-4620-9def-6f78dcb52d8e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:52.836467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.837294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.837714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.838058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.841236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:52.851412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.854966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.867317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:52.867983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:52.868262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:52.868530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:52.871050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:52.872183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:52.873137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:52.873137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:52.873137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:52.876315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 365/745] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:52.880432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:52.882195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:52.884050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:52.916278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:52.917351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:52.918326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:52.918326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:52.918326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:52.927410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 381/746] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:52.930681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.073183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43833ab-1bbb-4368-b721-532574ecdc65 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.099682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d899634-997e-470a-a221-f7ff7d52c5fb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.115518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.116631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.117629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:53.118609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.119326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.120150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:53.120729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.122548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.137936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 366/747] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:53.138920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.139411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.139606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.139893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.140170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.140812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:53.141123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.142556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.158519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 382/748] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:53.159579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.201641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:53.264995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08553ef-be9e-4bd1-b96d-92ab47ef8172 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.296846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100a30-52bf-4caf-8a72-b88f7088ca3f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.302031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.302988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.303477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.303896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.314930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:53.321266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:53.322407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:28:53.323528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:53.330483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 367/749] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:53.331724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.335682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.337836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.338320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.338807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.348885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.351947 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:53.368686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:53.369684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:53.370603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:53.374885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 383/750] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:53.375949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.419930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:53.448636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdb83b-baad-4a3d-8ffa-bc9899a3cdad None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.485595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.486574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.487103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.487734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.495357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.497280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.500523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fbca-f0b7-4ab9-8168-75eccd77be29 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.511549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:53.514023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:53.514964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:53.515964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:53.518707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 368/751] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:53.519821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.551021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.552451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.552932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.553327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.554478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:53.555133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.556885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.568773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 384/752] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:53.569715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.643458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30268f08-4c78-49e3-9045-bf436b6771e9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.680250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:53.681823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.682665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.683148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.683674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.684602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:53.685113 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.686056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b16a-ffb3-4f72-8029-f88f316c1ddc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.686999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.705484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 369/753] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:53.707217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.731020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.731671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.731954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.732231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.732984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:53.733398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.734875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.741365 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:53.755005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 385/754] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:53.755005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.846261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8b7bb-c1ad-494a-9bcf-c0c26abe3a77 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.873862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de66d3d-3870-4032-8cbe-6d904ee7968e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:53.893214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.894822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.895312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.895808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.911604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.913154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:53.913668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.913777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:53.914031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:53.914308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:53.915031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=ac16c8f79f7748ffa341705c05f28e8d) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:53.915344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:53.916898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:53.934932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 386/755] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/role_assignments?user.id=ac16c8f79f7748ffa341705c05f28e8d&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:53.934932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:53.955337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:53.956923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:53.957947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:53.957947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:53.957947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:53.959570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 370/756] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:53.963349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:53.995351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:54.103040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ffe02-296a-4480-aca7-386a767181df None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:54.127791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:54.145812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:54.146764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.147219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.147785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.149500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:54.150031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:54.151673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1af425-5463-4b6b-af08-fdbd48c33d24 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:54.167065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 371/757] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:54.173346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c70d-6263-4b91-8a88-c109e3d85206 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.173888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c70d-6263-4b91-8a88-c109e3d85206 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.174383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c70d-6263-4b91-8a88-c109e3d85206 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.176307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 372/758] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:54.177181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c70d-6263-4b91-8a88-c109e3d85206 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:54.204308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c36ae-7604-4626-ac00-998ee61c30ac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:54.242872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ead4-9474-45f8-bbb0-b73db7b4c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:54.243839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ead4-9474-45f8-bbb0-b73db7b4c30a None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.244226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ead4-9474-45f8-bbb0-b73db7b4c30a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.244604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ead4-9474-45f8-bbb0-b73db7b4c30a None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/2c129868b68642ccab8686ed6fe22906/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.246815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57ead4-9474-45f8-bbb0-b73db7b4c30a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=2c129868b68642ccab8686ed6fe22906, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:54.248489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57ead4-9474-45f8-bbb0-b73db7b4c30a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:54.315231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c70d-6263-4b91-8a88-c109e3d85206 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:54.328110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 387/759] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:53 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/2c129868b68642ccab8686ed6fe22906/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:28:54.329988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.330391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.331275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.374529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:54.377293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:54.393304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:54.395026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.395549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.396408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.410935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:54.414518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:54.425968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:54.443604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:54.444668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:28:54.445634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:54.450556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 373/760] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:28:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:54.457479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:54.537575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 388/761] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:28:54.612496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63182d-fe99-4baa-b59d-7f902882745a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:54.655821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:54.656806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.657295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.657791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.658740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:54.659314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:54.661553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c9e15-f752-4a18-bd44-8d1dc235be43 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:54.688830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 374/762] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Sep 7 14:28:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:54.700595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:54.719784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:54.808343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d162-3e60-4cec-ad38-c1fae4b49b95 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.808665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d162-3e60-4cec-ad38-c1fae4b49b95 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.808909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d162-3e60-4cec-ad38-c1fae4b49b95 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.810497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 375/763] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:54.816842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.817136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.817509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.821880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130dd5-619a-441d-8097-282cbac0fdb7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:54.840558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:54.841785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:54.888260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:54.888892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:54.889178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:54.889456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:54.929277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:54.940216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 376/764] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:28:54.948127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:54.979464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:54.980972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:54.993987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.095618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 389/765] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:28:55.105327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.157004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9336-086c-40ba-b723-826714d696d9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.246228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833c3ab-584d-480e-ba6d-f60608989bd8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.279839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.283924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.284064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.284634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.284778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.284963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.285060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.285251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.285545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.285966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.287612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.296795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.298623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:55.309343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:55.312037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:55.312879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 377/766] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Sep 7 14:28:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:55.313688 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:55.321588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:55.322598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:55.324663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:55.324663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:55.324663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:55.324663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 390/767] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:55.324663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.367949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.418179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fadaa-d35d-41d9-99f2-d0e49442b38d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.439766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f335d4-924f-4e64-b8ec-b1495b89504b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.454896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.455611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.455903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.456185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] PATH_INFO: `/v3/services/network` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.457516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.459241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:55.469835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:55.471219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:28:55.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:55.475531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 378/768] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:55.477112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.487312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.489058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.489521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.489968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.490941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:55.491496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.493025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.498869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 391/769] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:55.505110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.536076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.590244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1661d48-4e4c-43d6-858e-966eff449b25 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.609903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.618551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93b4d-9340-48ec-9417-e3ce6032e63e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.629779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.630396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.630683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.630964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.631759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:55.632069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.633510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.647254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 379/770] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:55.648986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.664657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.665679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.666135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.666601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.667406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] RBAC: Adding query filter params (name=network) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:55.667981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.669626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.675418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 392/771] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:55.676705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.767867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e663-4d61-4de7-8514-44501db0349a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.780573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.792177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9773c4-6395-4fc9-8806-457555b0fb43 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.805818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.806437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.806724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.807001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.807671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:55.807983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.809649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.820416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 380/772] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:55.820416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.839058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.840104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.840568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.841082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.850189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.852187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.863649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:55.866451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:55.867313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:55.868275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:55.870715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 393/773] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:55.871883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:55.926834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62546191-d865-4a42-bb1c-26e71a30690a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:55.964426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:55.965285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:55.965673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:55.966122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:55.966981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:55.967292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:55.968781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:55.979025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 381/774] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:55.980159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:56.001933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854709d2-7c48-4529-8aef-acc85cc3c6e1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:56.046505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:56.047624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.048057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.048491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.049495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] RBAC: Adding query filter params (interface=public, service_id=4dcf6760b0094624b13e8965a8b53b68, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:56.049969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:56.052736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:56.066290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 394/775] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/endpoints?service_id=4dcf6760b0094624b13e8965a8b53b68&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:56.067738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:56.089486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:56.094876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062cfbc-0a16-4ada-9194-3f84cf036bd5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:56.097848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:56.132861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:56.133583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.133932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.134271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.135196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:56.135622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:56.137415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:56.151011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 382/776] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:56.152477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:56.187536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5956-68e8-4c69-b38c-f33d6c880351 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:56.226918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:56.227909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.228454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.228875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.229838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] RBAC: Adding query filter params (interface=public, service_id=5a67d259f46345299f070397b3387556, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:56.230287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:56.231945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:56.239153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 395/777] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:28:56 2022] GET /identity/v3/endpoints?service_id=5a67d259f46345299f070397b3387556&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:56.240234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:56.268274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db605-914e-4bd4-b20a-32ed8ce732c4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:56.306246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:56.306885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.307245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.307751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.308402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:56.309952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:56.323407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 383/778] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:28:56 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:56.323407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:56.343609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:56.356056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:56.393948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387fee7-5cc2-45e4-8d2e-665de340de47 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:56.438435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a744aa-9e3b-4611-a08c-877407c2ab4c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:56.480920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e42b5e-d88a-473e-9a02-ac3b9a2e9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:56.481565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42b5e-d88a-473e-9a02-ac3b9a2e9529 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.481852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42b5e-d88a-473e-9a02-ac3b9a2e9529 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.482130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42b5e-d88a-473e-9a02-ac3b9a2e9529 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.482747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e42b5e-d88a-473e-9a02-ac3b9a2e9529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:56.484176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e42b5e-d88a-473e-9a02-ac3b9a2e9529 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:56.486691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:56.487403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.488469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.488752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.489765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=279a7226767e4381be66397afd481061) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:56.490084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:56.491579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5c81-5980-478a-9d13-5ea2325e345a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:56.492368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 384/779] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:28:56 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:56.493750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57ca5a-e195-4b3b-8a4b-b2ec19fd10bb None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.498272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 396/780] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:28:56 2022] GET /identity/v3/role_assignments?user.id=279a7226767e4381be66397afd481061&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:56.499680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57ca5a-e195-4b3b-8a4b-b2ec19fd10bb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.500124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57ca5a-e195-4b3b-8a4b-b2ec19fd10bb None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.501636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 385/781] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:56.508300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96a01-6782-4c32-a4c6-bc5c5129918e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.508592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96a01-6782-4c32-a4c6-bc5c5129918e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.508861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96a01-6782-4c32-a4c6-bc5c5129918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.530098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dba96a01-6782-4c32-a4c6-bc5c5129918e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:56.531597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dba96a01-6782-4c32-a4c6-bc5c5129918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:56.637110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 397/782] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:28:56.869426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300093-6db1-4a94-9add-5e95ce7a8637 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.869918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300093-6db1-4a94-9add-5e95ce7a8637 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.870310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300093-6db1-4a94-9add-5e95ce7a8637 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.872011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 386/783] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:56.877615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:56.877912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:56.878269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:56.898759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:56.899917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:56.928379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300093-6db1-4a94-9add-5e95ce7a8637 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:57.008231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 398/784] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:28:57.103226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:57.112996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300093-6db1-4a94-9add-5e95ce7a8637 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:57.149378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:57.150005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:57.150294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:57.150572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:57.162040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:57.166990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:57.167952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:57.168810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 387/785] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:57.174531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:57.183699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:57.306079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56f86a-304d-48fe-b440-0a55a19687a2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:57.336151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:57.342605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:57.343524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:57.344010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:57.344933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:57.345805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:57.346312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:57.348592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:57.370729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 399/786] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:57.385168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:57.449516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929930-c681-4373-91c4-2fba45ce4eb2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:57.488256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:57.488256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:57.488256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:57.488256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:57.500355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:28:57.508616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:57.509614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:57.510460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 388/787] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:57.525739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:57.538784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:57.551863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:57.603480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb35a9-192c-4773-983c-f591a5f6e0d3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:57.656820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:57.657818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:57.658331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:57.658807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:57.674731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:57.677637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:57.695550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:57.696857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:57.697765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:57.697765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:57.697765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:57.701055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 400/788] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:57.709077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:57.781810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908781b1-a849-4444-96a9-3022d0e5a0ec None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:57.886665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:57.888422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:57.889092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:57.890726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:57.891627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:57.892470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:57.895611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:57.910052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 389/789] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:57.921384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.008318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:58.035192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9807612-3d03-4a9c-b277-e6cd0e405438 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.073297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.074298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.074788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.075265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.085925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df28dc-4604-4982-b5e7-f20fa106f58e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.088236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.089927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:58.105897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:58.106989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:58.107923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:58.107923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:58.107923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:58.110044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 390/790] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:58.115933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.125165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:58.177836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.178768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.179139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.179593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.180563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:58.181032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.183136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.216036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 401/791] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:28:58.221126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.231142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a286-0d69-4240-b9d5-ae78390b5d41 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.258507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:58.268081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.269535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.270059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.270587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.271471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:58.272014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.273665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.291485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 391/792] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:58.293172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.402694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d307f2-0e09-48a1-a793-7d2b97e79701 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.422193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02517bc6-95f1-4560-8b3b-062e7a9e7ba9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.440692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.441438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.441722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.441998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.455403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.457677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:58.478493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:58.479543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:58.480518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 402/793] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:58.485175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.502259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.502928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.503278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.503587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.516703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.518281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:28:58.543207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:58.544286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:28:58.545227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 392/794] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:28:58.548528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:58.552379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.621681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50d14-36ef-46e3-8139-730d7271c8a3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.659957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.660581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.660869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.661143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.661875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:58.662181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.663633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.669077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:58.684167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 403/795] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:58.696435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.762282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5feda-1676-4a1d-ac55-a5aac9ef9dc7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.809450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:58.817602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f90ecf-c908-4163-ac00-88298afc6e7e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:58.855119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.856114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.857611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.858058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.869918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.871676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.873011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:58.873634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:58.873939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:58.874188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:58.874914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:58.875218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:58.876740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:58.889396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:58.890613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:58.891750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:58.891750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:58.891750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:58.893473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 404/796] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:58.900173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:58.918593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 393/797] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:58.934124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:59.068620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c9e0f-4d81-4cbb-a395-0ff822257f6a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.109048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.109912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.110346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.110795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.111754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:59.112210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.114416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.128588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 405/798] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:59.133849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:59.148605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:59.165054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d47f5d-caeb-46a2-8362-10961d06053c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.168558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:59.201988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.202861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.203311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.203749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.272340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d43a-1c5c-49a2-8878-a7792da6c62b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.302790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.304332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.308562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.309200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.309481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.309753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.317714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.319280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d44eb532-e0d5-4172-9500-dbd52f97651a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:28:59.333727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:59.334689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:59.335934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 406/799] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:59.336434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f20b4-aa75-4668-bc94-2873b2b61086 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.337090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f20b4-aa75-4668-bc94-2873b2b61086 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.337090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f20b4-aa75-4668-bc94-2873b2b61086 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.342632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 407/800] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:59.342632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938206-3ee1-4f92-887f-7eca4e692559 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.342632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938206-3ee1-4f92-887f-7eca4e692559 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.342632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938206-3ee1-4f92-887f-7eca4e692559 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.345255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 408/801] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:59.346392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99475-7f10-4a19-8341-63994d2e19d5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.346680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99475-7f10-4a19-8341-63994d2e19d5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.347620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99475-7f10-4a19-8341-63994d2e19d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.366013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-98d99475-7f10-4a19-8341-63994d2e19d5 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:59.367216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-98d99475-7f10-4a19-8341-63994d2e19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:59.415267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 394/802] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:28:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 14:28:59.416331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:59.420201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:59.427337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:59.435054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 409/803] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:28:59.436334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268fdba-bc08-46d3-9403-f82efe6624c6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.436734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268fdba-bc08-46d3-9403-f82efe6624c6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.437104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268fdba-bc08-46d3-9403-f82efe6624c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.455499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4268fdba-bc08-46d3-9403-f82efe6624c6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:59.457411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4268fdba-bc08-46d3-9403-f82efe6624c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:59.520240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0045-d164-4afd-91f3-83f3333fb91d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.535419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 410/804] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:28:59.535419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d05c-b51a-45af-b032-69c9efb0416a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.535419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d05c-b51a-45af-b032-69c9efb0416a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.535419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d05c-b51a-45af-b032-69c9efb0416a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.535419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 411/805] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:28:59.535419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d05c-b51a-45af-b032-69c9efb0416a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:59.578219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.579570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.579872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.580150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.580851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:28:59.581201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.582736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9c46-e3ac-4aaf-891f-3f662e3047a8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.601301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 395/806] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:28:59.602589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.602874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.603143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.621866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:28:59.623040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:28:59.676939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d05c-b51a-45af-b032-69c9efb0416a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.698764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:59.711876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:28:59.715786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 396/807] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:28:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:28:59.716886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:59.721985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.724476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.724995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.725500 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.738055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.741485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:28:59.758967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:59.760033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:28:59.760922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:28:59.760922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:28:59.760922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:59.763518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 412/808] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:59.764854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:28:59.874877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e60c-b1ef-4107-ae5c-f772038e52c8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.895726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589cbbb-a5c8-4dc1-be67-4271293221cc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:28:59.920364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.921043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.921323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.921597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/ac16c8f79f7748ffa341705c05f28e8d/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.930984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=ac16c8f79f7748ffa341705c05f28e8d, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.933017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.941089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:28:59.941716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:28:59.942126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:28:59.942398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:28:59.942979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:28:59.944375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:28:59.953526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:28:59.958501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:28:59.959354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 413/809] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Sep 7 14:28:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:28:59.960453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.005534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.012114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 397/810] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:28:59 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/ac16c8f79f7748ffa341705c05f28e8d/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:29:00.013033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.108884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.117746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a2d1-154b-4654-9206-757d9ed51d0b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.156402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.156928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.157208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.157482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.158150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:00.158454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.160773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.162168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cbae5-3df7-4c8b-bc76-38edcac660e0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.180591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 414/811] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:00.180591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.210757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.211509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.211795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.212068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.224334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:00.229640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:00.230590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:00.231482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 398/812] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:00.232239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.294863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ea79d-05df-484a-9a4d-ddafe2d71fa1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.296716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.331975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.332580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.332861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.333133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.333755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:00.334064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.335925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.345350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 415/813] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:00.345350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.351775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b53ef-609f-4be7-baa2-5912df48c70a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.367236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.388489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.389123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.389403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.389677 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.390285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.391673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:00.401454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:00.402496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:00.403412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 399/814] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:00.404248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.458105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46a1e-79cf-4847-9d95-c1f0f1bc14af None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.493293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.493932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.494210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.494486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.501289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.502738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:00.514853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:00.515847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 416/815] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:00.516776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.519923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13580b-a85e-4f91-9d4c-badcd478e0c6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.549042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.558145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.560478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.560478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.560478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.560478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:00.560478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.561660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.572014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 400/816] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:00.574769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.628613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.635607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508fe78-9d33-4065-870c-b92f4cfee6b2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.672465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.673088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.673373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.673651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.674289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:00.674596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.676618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.686207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 417/817] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:00.686207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.695542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4ef6-fb5a-4fa4-9d8d-12c57f424023 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.736120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.738087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.738481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.738777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.739462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] RBAC: Adding query filter params (name=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:00.739903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.741184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.746246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 401/818] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:00.747146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.792269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.803046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f5d81-59e7-4640-9d4d-5ed61a080a58 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.845632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.846238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.846517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.847394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.848168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:00.848593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.850025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.854649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aea59-3734-432b-ac67-dfc485a2cb82 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:00.858195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:00.864093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 418/819] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:00.865384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.900042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:00.900683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:00.900964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:00.901243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:00.913815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:00.915753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:00.937244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:00.938318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:00.939230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:00.939230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:00.939230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:00.939230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 402/820] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:00.939230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:00.989396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842b7ac-f4e6-43c2-afd0-b14940d9a1a5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.026896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.027667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.027963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.028227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.028949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.030351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.043670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcba23a-4799-4191-89cc-24f1593da035 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.077619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.078214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.078494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.078768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.079474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] RBAC: Adding query filter params (type=network) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:01.079778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.083776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.087177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 403/821] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:01.089722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:01.111354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:01.144364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 419/822] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:01.145362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:01.166455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:01.209700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5fc08-bde4-453e-9f15-266efaf0999e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.263952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.265128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.265687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.266216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.267303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=2c129868b68642ccab8686ed6fe22906) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:01.267856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.270218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.284049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 404/823] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:01 2022] GET /identity/v3/role_assignments?user.id=2c129868b68642ccab8686ed6fe22906&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:01.285508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:01.297188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0cb20-e2f1-4af1-b73e-cb24df9e1cb6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.349754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.350395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.350741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.351023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.352513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:01.352513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.353551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.369673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 420/824] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:01.376106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:01.424113 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:01.451528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e47d-56b1-4533-98c6-0b90e14dc1af None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.473975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:01.501582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.502570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.503111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.503623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.505607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.507258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.520045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a42937-0c75-4b31-99df-49e9147506c5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.560136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.560780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.561109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.561388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.570134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.571657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:01.583766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:01.584760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:01.586586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 421/825] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:29:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:01.591018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:01.602878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 405/826] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:01.724491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47906a-453a-460b-922b-37af66f6fe59 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.755329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:01.774624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.775180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.775494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.775773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.776538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:01.776844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:01.778311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:01.798828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 422/827] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Sep 7 14:29:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:01.805426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:01.930844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443a9a-cae0-4105-b470-632af468afc8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:01.976505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:01.977149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:01.977429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:01.977708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:01.980706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:01.990357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:02.000896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:02.007363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:02.008389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:02.009299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:02.009299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:02.009299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:02.009299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 406/828] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:02.015040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:02.140192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053e167-30eb-4498-bbbd-b946ce2f7228 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:02.179905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:02.180521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.180804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.181080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.181727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:02.182035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:02.183419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:02.196245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 423/829] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:02.201341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:02.332187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb0b0-ec25-4a5a-a432-bfb6a12ce783 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:02.372160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:02.373176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.373681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.374178 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.382563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:02.384357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-67a5657d-06b3-4342-a993-8264b220a67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:02.396817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:02.397802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:02.398698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:02.401102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 407/830] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:02.407404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:02.410011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9501-1fa6-4e8e-91d7-99d7262b9ec4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.410011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9501-1fa6-4e8e-91d7-99d7262b9ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.410011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9501-1fa6-4e8e-91d7-99d7262b9ec4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.410751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 408/831] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:02.415845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.416134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.416417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.435000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:02.436217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:02.457477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:02.485767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:02.519736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 409/832] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:02.533225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72adebe-d359-42cc-9647-8f647a4a27ab None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:02.568963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:02.569957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.570434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.570929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.571843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:02.572349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:02.573996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:02.588183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 424/833] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:02.594570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:02.700964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b5618-fee8-4323-987e-3eed35ce5479 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:02.740058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:02.741068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.741548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.742045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/279a7226767e4381be66397afd481061/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.757637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=279a7226767e4381be66397afd481061, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:02.759406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:02.792977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:02.826395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 410/834] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:29:02 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/279a7226767e4381be66397afd481061/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:29:02.926733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:02.930827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d64b-ca38-4553-8fdf-1b4f4df9294b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:02.972758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:02.973603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:02.973887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:02.974166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:02.986556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:02.992243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:02.993494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:02.994704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 425/835] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:02.999665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:03.033444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:03.113625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e86e-6b83-4a7c-991b-074cfb889da1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:03.155076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:03.155877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.156259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.156653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.157424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:03.157830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:03.160136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:03.169426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 411/836] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:03.175409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:03.287425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f79f1c-de68-45f0-8d22-b701aadc73a4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:03.326525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:03.327329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.327826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.328194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.341177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:03.342771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:03.358320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:03.360196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:03.362058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:03.362058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:03.362058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:03.362430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 426/837] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:03.368327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:03.471907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:03.482022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d475-d6ae-4c6a-9433-f40f53119914 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:03.518505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:03.519576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.520142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.520612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.521431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:03.521839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:03.523317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae5ed-d215-4bf2-8d56-2098aa1396c4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:03.536443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 412/838] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:03.544534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:03.561705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:03.664932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e887354-3bcd-4522-a2c5-b90a37e27f7f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:03.700440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c328f-4521-4d14-8450-3145394b147a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.701087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c328f-4521-4d14-8450-3145394b147a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.701995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c328f-4521-4d14-8450-3145394b147a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.703785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:03.704263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 413/839] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:03.704369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.709558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.709558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.711564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.712081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.712566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.714593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:03.716078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:03.728970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:03.729984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 14:29:03.730942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:03.733209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 427/840] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:29:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:03.741130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:03.741324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:03.741413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:03.816561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:03.836647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 414/841] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:03.856072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435bde1-4446-4468-a6f9-1e49205ccb9a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:03.897831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:03.898441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.898718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.898988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.899826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:03.900130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:03.901601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4e94-27c2-4bd0-82e1-6366aa9642d9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:03.926901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 428/842] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Sep 7 14:29:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:03.932725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:03.977073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d4d94-621b-47b3-acaa-2b4f2d16620a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.977073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d4d94-621b-47b3-acaa-2b4f2d16620a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.977336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d4d94-621b-47b3-acaa-2b4f2d16620a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:03.979979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 429/843] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:03.984064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:03.984351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:03.984629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.002627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:04.004546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:04.023896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.047779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d3c5-064e-45be-a451-286be9198fc0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.086876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 430/844] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:04.096097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.097441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.097862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.098299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.123355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.185180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.186617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.196360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.252092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c317c20-b15c-4f4b-ba77-1b685a0afa70 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.275758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.298301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 415/845] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:04.302077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.302716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.302997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.303342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.303980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.305391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.306016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:04.316916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:04.317961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:04.318836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 431/846] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:04.325967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.424357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908df050-7db4-4349-9aa6-f0c536ffc456 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.432093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f50f-b5fa-49af-8970-12cd430097aa None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.458437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.465099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.465786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.466081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.466362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.470769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.477797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.477797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.477797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.477797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:04.477797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.477797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.478281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.478368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.483690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 432/847] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:04.483690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:04.500631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:04.501829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:04.503810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:04.503810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:04.503810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:04.507328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 416/848] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:04.507839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.540566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.592556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1de820-0e63-4c68-9840-d3c768c54f16 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.612690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f5ce2-065b-4ccf-a769-44c3b0cc1576 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.630218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.631060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.631559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.631933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.632636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.634291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:04.644688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:04.646067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:04.652154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 433/849] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:04.653154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.655338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.655988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.656274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.656552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.657195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:04.657504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.658935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.664004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 417/850] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:04.664004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.738591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.787296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:04.795990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc224-e648-437f-87a5-55a1456f9a5a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.815607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226013a-b28b-4006-b907-2ca61c9fcba5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:04.844930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.845959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.845959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.846280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.847665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:04.848052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.850339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.857072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 418/851] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:04.864864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:04.865065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:04.865151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:04.865151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:04.865151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:04.865499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:04.865761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:04.867144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:04.880906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 434/852] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:04.886669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:05.012992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844e4a-9582-4443-9ecc-894b64ca892c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:05.028230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876aa57-a696-4157-b4cd-8e277aa20fb4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:05.044220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:05.059809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:05.061442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.061442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.061442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.062373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:05.062908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:05.064501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:05.067668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:05.068572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.068922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.069192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.071260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 419/853] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:05.081500 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:05.082966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-45fc5828-ff71-4b6d-8002-bb51b89d5c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:05.097549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:05.098610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:05.099642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 435/854] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:05.105186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:05.136781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:05.227324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910835c-1298-41f9-a0bf-bab76f7b1636 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:05.253287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721746f0-801d-4090-ae7a-170dc7d660b0 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.253584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721746f0-801d-4090-ae7a-170dc7d660b0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.253901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721746f0-801d-4090-ae7a-170dc7d660b0 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.255287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 436/855] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:05.261046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.261332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.261608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.267583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:05.269138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.269767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.270043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.271651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:05.271978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:05.274777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:05.284851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:05.285533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:05.286835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 420/856] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:05.297477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:05.375535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 437/857] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:05.397894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:05.415742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a30d58-f908-4277-8cb8-e7f0ef352f69 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:05.452921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:05.453581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.453864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.454196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.454929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=ac16c8f79f7748ffa341705c05f28e8d) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:05.455242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:05.457157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:05.472088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 421/858] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:05 2022] GET /identity/v3/role_assignments?user.id=ac16c8f79f7748ffa341705c05f28e8d&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:05.652399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:05.772779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944147-622c-416b-a96b-8ffd05455081 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:05.774313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:05.809912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:05.810546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:05.810826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:05.811099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:05.823082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:05.828274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:05.829237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:05.830119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 438/859] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:29:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:05.840067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:05.962138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae305f1c-8b69-4e89-aa16-419e50741bee None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:06.011017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:06.011673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:06.012021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:06.012313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:06.013020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:06.013335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:06.014820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:06.029186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 422/860] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:29:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:06.031090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:06.171186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02ae1d-f16a-4644-91b2-7ade5cde60bb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:06.212094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:06.212661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:06.212942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:06.213216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:06.225046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:06.226583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:06.244875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:06.246613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:06.248260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:06.248260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:06.248260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:06.250777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 439/861] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:06.253366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:06.270528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:06.383143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4f8c-04b6-4af2-bfd9-e7f3c71b20f2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:06.430162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:06.430801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:06.431086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:06.431367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:06.432046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:06.432421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:06.433721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:06.451845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 423/862] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:06.453583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:06.484176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:06.588357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d71aff-00de-4ec2-9674-944d880065c9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:06.638135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:06.638770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:06.639042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:06.639321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:06.650460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:06.651951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:06.669860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:06.671313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:06.672350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 440/863] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:29:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:06.677910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:06.770013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:06.808053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7788013-9e2f-4fa9-b3be-533395887eb6 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:06.851129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:06.852227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:06.852227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:06.852600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:06.854408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:06.854408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:06.855366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa6a1a-bec9-4e3a-b48a-62a411cdd6a1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:06.883489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 424/864] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Sep 7 14:29:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:06.885744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:06.982391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:07.015713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb75e-b828-4d47-9c29-1fa3ddd6456b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:07.052957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:07.053489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.053773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.054050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.137853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:07.139325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:07.209416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926304e0-03ab-47d5-8905-5ad0e63ca88d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.210046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926304e0-03ab-47d5-8905-5ad0e63ca88d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.210247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926304e0-03ab-47d5-8905-5ad0e63ca88d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.211990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 425/865] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:07.217240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.218375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.218656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.227960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:07.241943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:07.261530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:07.261694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 441/866] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 14:29:07.265815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:07.344595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 426/867] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:07.382927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a094-9032-43da-942c-7dc6d304c968 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:07.421978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:07.422673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.422954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.423225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.434406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:07.435884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5f92651e-2e9d-4e95-8699-0aa1bc20ebc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:07.451222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:07.452263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:07.453165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:07.453165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:07.453165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:07.457811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 442/868] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:07.459293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:07.477615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e600e4-48cc-4bce-9fe7-2d63bbf6002e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.477898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e600e4-48cc-4bce-9fe7-2d63bbf6002e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.478171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e600e4-48cc-4bce-9fe7-2d63bbf6002e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.479976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 443/869] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:07.485312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602517-15b1-445a-bf83-67740958b024 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.485713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602517-15b1-445a-bf83-67740958b024 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.485991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602517-15b1-445a-bf83-67740958b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.506446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-51602517-15b1-445a-bf83-67740958b024 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:07.507680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-51602517-15b1-445a-bf83-67740958b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:07.530754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:07.536927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:07.591282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 444/870] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:07.593144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf7a17-4de5-4312-bf18-f96002c82617 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:07.629396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:07.630322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.630791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.631242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.632099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:07.632603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:07.634150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:07.647288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602517-15b1-445a-bf83-67740958b024 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:07.653423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 427/871] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:07.656115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:07.775610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602517-15b1-445a-bf83-67740958b024 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:07.798184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961a22-dea5-432d-b2a7-cf2ab41f2cc2 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:07.820077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:07.820867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.821150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.821428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.822333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:07.823497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:07.824886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:07.842144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:07.842860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:07.843205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:07.843581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:07.850330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:07.851859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:07.863563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:07.865927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 428/872] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:07.867057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:07.912832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 445/873] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:29:07 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:07.914195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:07.953140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:07.999226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66d365-71c6-4189-aea9-d1ba6b964b6b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:08.058240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aa662-05d4-4aa1-a667-bd1912080746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:08.059181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa662-05d4-4aa1-a667-bd1912080746 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.059496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa662-05d4-4aa1-a667-bd1912080746 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.059777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa662-05d4-4aa1-a667-bd1912080746 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.060462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aa662-05d4-4aa1-a667-bd1912080746 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:08.062155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aa662-05d4-4aa1-a667-bd1912080746 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:08.074731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556c45d-8553-4cd4-96b9-bcdec6b71491 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:08.116446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:08.117112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.117391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.117669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.118361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:08.118663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:08.120137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2276-cb8b-41c2-8e3a-0dcc18f87c75 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:08.133187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 446/874] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:08.134441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeeeb9-f1ff-4461-a20a-7b60725f3843 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.134725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeeeb9-f1ff-4461-a20a-7b60725f3843 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.134998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeeeb9-f1ff-4461-a20a-7b60725f3843 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.136315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 447/875] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:08.139187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeeeb9-f1ff-4461-a20a-7b60725f3843 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:08.161511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 429/876] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:29:07 2022] POST /identity/v3/services => generated 269 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:08.163339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.164428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.164940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.190776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:08.193867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:08.238114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:08.241751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:08.287244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeeeb9-f1ff-4461-a20a-7b60725f3843 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:08.289664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 430/877] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:08.337275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:08.337938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.338220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.338533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.339883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=279a7226767e4381be66397afd481061) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:08.340278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:08.341727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:08.351691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 448/878] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:08 2022] GET /identity/v3/role_assignments?user.id=279a7226767e4381be66397afd481061&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:08.566959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:08.675488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0d44b-941f-4a44-b8cb-ba7074cd83f2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:08.712975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:08.713621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.713906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.714184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.714781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:08.716201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:08.726242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:08.731667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:08.732549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 431/879] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:08.733902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:08.848785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6224ff-e1d9-416c-8167-de05029dc560 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:08.887144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:08.887834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:08.888115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:08.888389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:08.889062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:08.889367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:08.890839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e89c7-34df-4e18-bb4c-c248c966294a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:08.893385 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:08.898204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 449/880] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:08.903873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:08.960547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:09.029078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de14b05-7b8b-49ce-8d92-c0fbdb6fa00f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:09.067753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:09.068374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:09.068657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:09.068930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:09.069568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:09.069875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:09.071239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145a934-9760-4fe1-a13b-f39406a3bd53 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:09.076641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 432/881] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:10.217585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ece10c-36b9-41b2-860d-22ee989b5650 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.218091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ece10c-36b9-41b2-860d-22ee989b5650 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.218091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ece10c-36b9-41b2-860d-22ee989b5650 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.219651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 450/882] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:10.225101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d066-4cb6-4193-9192-9aaa96a76bc1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.225525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d066-4cb6-4193-9192-9aaa96a76bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.225674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d066-4cb6-4193-9192-9aaa96a76bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.246731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c9f2d066-4cb6-4193-9192-9aaa96a76bc1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:10.247964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c9f2d066-4cb6-4193-9192-9aaa96a76bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:10.333193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 433/883] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:10.485611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4fee-e098-4062-af0b-f0a3d8164af1 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.485832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4fee-e098-4062-af0b-f0a3d8164af1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.486157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4fee-e098-4062-af0b-f0a3d8164af1 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.487891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 451/884] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:10.493199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.493495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.493755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.512393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:10.513587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:10.533183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:10.589323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 434/885] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:10.620123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4fee-e098-4062-af0b-f0a3d8164af1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:10.739124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4fee-e098-4062-af0b-f0a3d8164af1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:10.777568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:10.778280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.778617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.778925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.779640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:10.781033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-972c3cde-488a-4876-9f9a-3201d57125f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:10.791824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:10.792912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:10.793747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 452/886] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:10.801316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:10.837071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e76a-77fe-4e55-8df6-4f5946df612a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.838012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e76a-77fe-4e55-8df6-4f5946df612a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.838507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e76a-77fe-4e55-8df6-4f5946df612a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.840559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 453/887] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:10.847150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.848349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.849033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.869672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:10.871191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:10.934937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe854d4-8d30-45dd-96f7-a7e3f6494935 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:10.943013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:10.956110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 454/888] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:10.957916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:10.974668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:10.975276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:10.975593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:10.975874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:10.976524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:10.976833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:10.978426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:10.983749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 435/889] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:10.989224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.022230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.089728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83bef0-14ed-4897-ba02-744d2b56709e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.126703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8b28-bad0-4de1-8bae-9ec4bd784526 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.137218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.137894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.138177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.138435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.139049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.141166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:11.154545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:11.155696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:11.157352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 455/890] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Sep 7 14:29:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:11.162506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.188059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.188683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.188971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.189252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.189980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:11.190763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.192412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.200086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 436/891] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:11.206007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.235158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.286685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e68c15-af31-4b34-b560-6648f09090a0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.301619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.324558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c64c2-1350-4269-b697-54c79f9b6c32 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.329703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.330380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.330706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.331092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.331765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:11.332096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.334337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.345918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 456/892] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:11.347548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.371448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.372230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.373024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.373399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.374202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] RBAC: Adding query filter params (interface=public, service_id=4c0bd001ab434286856c212171781e16, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:11.374613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.376108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.385384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 437/893] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/endpoints?service_id=4c0bd001ab434286856c212171781e16&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:11.386225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.474071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19307ed-c2d0-460b-a947-246e08dcd719 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.496811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.502970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efc70-3d5e-4b6f-a679-7b85bcfb5aa3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.508580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.509210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.509489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.509758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.523470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:11.528791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:11.531485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 457/894] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:11.532437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.542820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.543363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.543673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.543949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.544583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:11.544889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.546247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5c09f-d22d-45df-9c44-f73806844f6c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.551674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 438/895] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:11.552987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5a2b-3359-4374-b988-7420b5b3f9db None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.553382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5a2b-3359-4374-b988-7420b5b3f9db None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.553774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5a2b-3359-4374-b988-7420b5b3f9db None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.555356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 439/896] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:11.556233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5a2b-3359-4374-b988-7420b5b3f9db None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.568127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.639808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c58ab-7de3-4266-ba83-3e503f7785b2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.663803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5a2b-3359-4374-b988-7420b5b3f9db None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.675680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.676299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.676578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.676852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.677462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.678833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.684758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 458/897] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:29:11.685367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.702523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.703158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.703473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.703791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.704554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:11.704867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.707296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b6de-4292-4b96-afeb-5111c96b2fca None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.724961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 440/898] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:11.724961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.724961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.724961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.744875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:11.746194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:11.762594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.821823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:11.828435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 441/899] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:11.829933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.841684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91fa1-5bae-43eb-9124-6c44a60e2f06 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:11.895711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:11.896704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:11.897049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:11.897326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:11.898046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] RBAC: Adding query filter params (interface=public, service_id=ad3d9900032948efa80808a4d9694db3, region_id=RegionOne) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:11.898362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:11.900291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:11.906106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 459/900] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/endpoints?service_id=ad3d9900032948efa80808a4d9694db3&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:11.912239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:11.973558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478363e1-2b34-4a44-9f3b-147064e44806 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.012848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.013500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.013786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.014064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.025099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1891cd-0d1e-439e-a789-e453bb03246f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.025594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.027161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:12.036899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:12.044309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:12.056458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:12.057373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:12.057373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:12.057373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:12.057373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 442/901] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:12.057373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:12.070851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.072038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.072539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.072970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.073763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.075384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:12.087399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 460/902] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:29:11 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:29:12.139996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:12.144874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:12.184529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a9bf-a9c2-4d3d-8213-dd04d79b1aff None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.226620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.227248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.227573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.227910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.228581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:12.228944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.230564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:12.246929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 443/903] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:12.253537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:12.291680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810dbc-3a76-43be-91cd-17146f574a29 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.337318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.337850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.338131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.338405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.339063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.340679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:12.375506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c29f-f439-45b6-b2be-07088da83a10 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.393675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:12.415771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.416418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.416703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.416981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.430064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.432858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:12.440060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 461/904] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:29:12 2022] POST /identity/v3/services => generated 241 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:12.453245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:12.454310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:12.455293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 444/905] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:29:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:12.462059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:12.504586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:12.595423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ef13f-5314-4478-bdc4-8ba6b93e8ce9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.638230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.638857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.639138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.639440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.640185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:12.640491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.642142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:12.667952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 462/906] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Sep 7 14:29:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:12.673216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:12.801856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffbcd-bf70-4f66-8dbf-a056d298ad28 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:12.839454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:12.840508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:12.841005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:12.841598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:12.905034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:12.918565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:12.920138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:13.028606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 445/907] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:12 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:13.034320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:13.138630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:13.155752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b5c5c-6544-4273-8efc-31a274b400d5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:13.206644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:13.207286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:13.207605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:13.207882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:13.218796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:13.220288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:13.236095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:13.237665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:13.238587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:13.238587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:13.238587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:13.238587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 463/908] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:13.245462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:13.325398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:13.359881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8309ef6-f35f-48aa-acac-c5d728bf7228 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:13.398654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:13.399283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:13.399586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:13.399867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:13.400521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:13.400833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:13.402195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:13.420680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 446/909] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:13.430869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:13.551561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33c0c-bc2a-45c0-8f84-d368b3124ee4 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:13.591927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:13.592943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:13.593462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:13.593941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:13.602304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:13.604072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:13.606974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:13.617267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:13.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:13.619614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:13.621049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 464/910] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:13.627007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:13.739254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a6871-c9e1-452c-9711-c3bc1444ca8e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:13.772963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:13.778099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:13.778786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:13.779073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:13.779354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:13.780087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:13.780399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:13.781839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf1e8-ba09-434c-b1b9-b6f4ac98ad00 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:13.795098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 447/911] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:13.801677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:13.918737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb459ed9-28b0-4f2f-aa1c-f595e272d01f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:13.958091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:13.958704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:13.958986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:13.959260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:13.960353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] RBAC: Adding query filter params (role.id=bdeb1c5206ef45f291c45c4d1523862e, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=279a7226767e4381be66397afd481061) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:13.960665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:13.962097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1020-435a-4194-ad86-0fe4383a8760 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:13.968420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 465/912] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:13 2022] GET /identity/v3/role_assignments?user.id=279a7226767e4381be66397afd481061&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=bdeb1c5206ef45f291c45c4d1523862e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:14.124230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8610aa-94e4-4913-9db7-b8569f3f4d21 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:14.124597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8610aa-94e4-4913-9db7-b8569f3f4d21 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:14.124806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8610aa-94e4-4913-9db7-b8569f3f4d21 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:14.126622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 448/913] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:14.132717 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931226-2194-4c1b-a62d-4db67c25f3f6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:14.133035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931226-2194-4c1b-a62d-4db67c25f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:14.133281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931226-2194-4c1b-a62d-4db67c25f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:14.153181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ab931226-2194-4c1b-a62d-4db67c25f3f6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:14.154402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ab931226-2194-4c1b-a62d-4db67c25f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:14.228512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:14.244932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 466/914] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:14.447137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea1756-4f6f-457b-9ee1-6b0c27f9ca41 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:14.448020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea1756-4f6f-457b-9ee1-6b0c27f9ca41 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:14.448466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea1756-4f6f-457b-9ee1-6b0c27f9ca41 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:14.450246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 449/915] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:14.461480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:14.461985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:14.462250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:14.482778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:14.484186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:14.518283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea1756-4f6f-457b-9ee1-6b0c27f9ca41 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:14.573547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 467/916] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:14.637284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea1756-4f6f-457b-9ee1-6b0c27f9ca41 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:14.674988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:14.675796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:14.676084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:14.676417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:14.677013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:14.678442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:14.688869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:14.699782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:14.701812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 450/917] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:14.703761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:14.807211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976ee5f-0765-4e98-a757-a7837f1fd49f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:14.840188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:14.849260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:14.849895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:14.850176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:14.850452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:14.851109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:14.851439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:14.852926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:14.858662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 468/918] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:14.865036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:14.868837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:14.963024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:15.010572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c13b-a7cb-4f32-a457-3010e5c19f75 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.019609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d177-3481-48bb-a366-ab97d53e081b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.051039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.052162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.052580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.052865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.053507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:15.053821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.055194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f856b2b-4833-4237-b7cf-31e2ea8c8420 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.056074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.056708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.056991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.057271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.057854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.059219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.060991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 451/919] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Sep 7 14:29:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:15.062820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37d92-598a-43c9-b394-af631553ae63 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.063440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37d92-598a-43c9-b394-af631553ae63 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.063890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37d92-598a-43c9-b394-af631553ae63 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.066258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 452/920] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:15.068881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37d92-598a-43c9-b394-af631553ae63 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-bafcefcc-9a59-417c-9301-6999b42ef97d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:15.069861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:15.070876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:15.071854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 469/921] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Sep 7 14:29:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:15.077432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.077745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.078009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.098744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:15.100168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:15.162100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:15.184749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 470/922] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:15.187410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37d92-598a-43c9-b394-af631553ae63 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.192347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.213971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:15.230963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.231589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.231870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.232139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.232809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.234175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.325800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504903-c216-4ebc-a6d9-398617676d5f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.375851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 453/923] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:29:15.378734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.379852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.380406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.380903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.388008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:15.388008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.388008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.391062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 471/924] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:15.396947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.477216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.547328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:15.557493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dab3c-145d-452a-b5e4-5090229c9a0c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.609447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.610233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.610527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.610802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.611512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:15.613035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.614435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.620252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 454/925] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:15.625991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.636571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848463b9-e8d3-4882-a4af-1a40d814d0b9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.682013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.682834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.691252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.691252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.691252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.691566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:15.691658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:15.701791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:15.702969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:15.704100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 472/926] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:15.710540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.775975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825691-e017-4a70-9d0f-f08d79ec1f55 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.828019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.828736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.829025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.829406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.830089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.831846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.840668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720214ea-915a-4d18-9c23-1d0ee9abc64c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:15.851804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:15.880553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:15.881207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:15.881501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:15.881763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:15.882404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:15.882712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:15.884122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:15.889125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 473/927] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:15.895294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:15.953913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 455/928] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:29:16.029577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db46d6-8157-47e1-bdc8-287858a18b6e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:16.083870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:16.085130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:16.085640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:16.086113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:16.086968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:16.087575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:16.089250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e02715-677d-4fa0-b4b3-fe86b682a06e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:16.101942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 474/929] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:16.104299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:16.225803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:16.232686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3e25-2a46-48c4-9c0d-51c0de897151 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:16.281617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:16.282930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:16.284262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:16.284985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:16.286337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] RBAC: Adding query filter params (interface=public, service_id=6c3374bab05544db93ce05759cbdbaff, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:16.287090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:16.289561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:16.298210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 456/930] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:29:16 2022] GET /identity/v3/endpoints?service_id=6c3374bab05544db93ce05759cbdbaff&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:16.304973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eca7c-4d6d-4ca8-97b2-b06ce7c0e980 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:16.304973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eca7c-4d6d-4ca8-97b2-b06ce7c0e980 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:16.304973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eca7c-4d6d-4ca8-97b2-b06ce7c0e980 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:16.305423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:16.307611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 475/931] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:16.311217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:16.311540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:16.311814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:16.332029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:16.333286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:16.363042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:16.428010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac6f43-5a03-4658-99a7-5364d0810b83 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:16.433280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 476/932] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:16.468776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:16.469788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:16.470303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:16.470777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:16.472076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:16.473645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:16.487549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 457/933] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:29:16 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:29:16.713465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:16.821950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd641-5ec1-496f-aac4-2b55715ce6ca None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:16.859423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:16.860076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:16.860359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:16.860636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:16.871856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:16.876709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:16.878486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:16.879349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 477/934] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Sep 7 14:29:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:16.886619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:16.913890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:17.005521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b902-e9df-45b9-a97c-67c9609c163b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:17.045217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:17.046246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.046731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.047207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.048094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:17.048622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:17.051097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:17.060239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 458/935] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:29:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:17.067518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:17.091158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:17.176585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012ea2-80c3-4b3b-9a9b-8a46525e1f75 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:17.216133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:17.216768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.217050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.217324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.229291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:17.230748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:17.246865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:17.248103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:17.249080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:17.249080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:17.249080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:17.249080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 478/936] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:17.256465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:17.353476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:17.369543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da34867-16ad-4a91-8662-617749ae715d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:17.405709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:17.406325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.406608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.406928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.407613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:17.407922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:17.410345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:17.422807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 459/937] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:17.428933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:17.525876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:17.558463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f6fbb-20cb-4cd9-be4c-dbbe47c0c829 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:17.600759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:17.601771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.602283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.602754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.614150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:17.616679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-12b34200-3d48-40ec-ad65-a06a44044a4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:17.640138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:17.641956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:17.646287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:17.650773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 479/938] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:29:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:17.660347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:17.695573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11921-dd53-4751-9ff2-acef2a98c718 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.695981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11921-dd53-4751-9ff2-acef2a98c718 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.696166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11921-dd53-4751-9ff2-acef2a98c718 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.697692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 480/939] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:17.702873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.703217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.703508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.724072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:17.725248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:17.812898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bf034-daf8-4759-93c4-edd4b54f4a1a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:17.820687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 481/940] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:17.853161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:17.853774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:17.854072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:17.854371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:17.855075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:17.855426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:17.856839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:17.876302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 460/941] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Sep 7 14:29:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:17.882674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:17.963772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:18.001002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed6ccc-4dd9-453e-9714-909f49fa1f9f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.038439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.039093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.039392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.039675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.051126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.052639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:18.068578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:18.069721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:18.070838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:18.070838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:18.070838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.070838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 482/942] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:18.075574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.086215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:18.110610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.206143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0affb-6a48-461d-ac66-7b4c40b59cac None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.246175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.246835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.247123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.247435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.248100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:18.248411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.249091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d05fb-a4be-45d5-83df-f7301071e7e8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.249807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.264938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 461/943] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:18.270752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.271354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:18.304457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.305364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.305794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.306215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.307005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.308624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.312199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING keystone.server.flask.common [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 14:29:18.353751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:18.365435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.sql.core [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 14:29:18.365435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 14:29:18.365435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [parameters: {'id': 'a0df67fb38f3408f9ad7407b231e94a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 14:29:18.365435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0df67fb38f3408f9ad7407b231e94a9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0df67fb38f3408f9ad7407b231e94a9. Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 14:29:18.390058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 14:29:18.391125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application yield resource Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise self.value Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application session.commit() Sep 07 14:29:18.392242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.flush() Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application compat.raise_( Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 14:29:18.395556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 14:29:18.396792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 14:29:18.397605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [parameters: {'id': 'a0df67fb38f3408f9ad7407b231e94a9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.398558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:18.401228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0df67fb38f3408f9ad7407b231e94a9. Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.406131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 483/944] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Sep 7 14:29:18 2022] POST /identity/v3/projects => generated 262 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:18.410064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.414163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9dfcd-f835-477c-b906-b816dc4f22dd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.469776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.472311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.473074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.473897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.489221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.492744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-5805a555-147a-4305-a7ec-e4483521dbf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:18.519810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:18.520927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:18.522043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:18.523540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 462/945] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:18.524838 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600bd7d-5754-4e02-a70c-3c5d2501098f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.525132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600bd7d-5754-4e02-a70c-3c5d2501098f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.525413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600bd7d-5754-4e02-a70c-3c5d2501098f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.526868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 463/946] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:18.529129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600bd7d-5754-4e02-a70c-3c5d2501098f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.559567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae88352-3fd5-48c1-94f9-f681f775238b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.607249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.607835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.608151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.608430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.616147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.617816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-92391bbe-0fe2-497f-a453-60095045237a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:18.630753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:18.631855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:18.632773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:18.636766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 484/947] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:18.638234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.638518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.638790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.658179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600bd7d-5754-4e02-a70c-3c5d2501098f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.662061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:18.663026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:18.685985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:18.693413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:18.697896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.698526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.698814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.699094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.699834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:18.700139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.701568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.714276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 464/948] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:18.715125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.747091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 485/949] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:18.747091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:18.857936 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52448-1d7b-4566-9ffd-905bd8e00820 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.858853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9411796-b6e5-442c-b85c-0a7d37e708e3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:18.896610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.897229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.897511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.897785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.898454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:18.898760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.900247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced212-8e43-4238-aba4-3e7b0bba0139 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.901449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:18.902322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.902607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.902882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/279a7226767e4381be66397afd481061/roles/bdeb1c5206ef45f291c45c4d1523862e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.905674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=279a7226767e4381be66397afd481061, role_id=bdeb1c5206ef45f291c45c4d1523862e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:18.907241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:18.921727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 465/950] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:18.923058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6305-a98a-48cc-bc2f-87d633ce2c1e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.923347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6305-a98a-48cc-bc2f-87d633ce2c1e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.930749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6305-a98a-48cc-bc2f-87d633ce2c1e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.930749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 466/951] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:18.932182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:18.932663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:18.933172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:18.957066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:18.958704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:19.022017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:19.038272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 486/952] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:29:18 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/279a7226767e4381be66397afd481061/roles/bdeb1c5206ef45f291c45c4d1523862e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:29:19.039329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.067733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 467/953] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:19.074519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:19.178067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f093-73f3-4215-a3b2-b3501f65419d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:19.222240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:19.223115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:19.223621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:19.223945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:19.224658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:19.226187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:19.238352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:19.239738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:19.240945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 487/954] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:19.247712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.356262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.377671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ec1bf-918b-4def-a19c-432043a932f9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:19.422479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:19.423609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:19.424588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:19.425293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:19.426385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:19.427248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:19.428848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:19.436340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 468/955] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:19.445791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.452196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:19.470838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8d09e-a238-485b-99a5-4a6e570c4107 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:19.490510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:19.514014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:19.514897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:19.515353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:19.515814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:19.516589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:19.518323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:19.528058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:19.529310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:19.530453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:19.534303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 488/956] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:19.539906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.573548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b79d-9fa3-460a-8149-74158a941f7b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:19.613919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:19.614592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:19.614885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:19.615162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:19.615836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:19.616144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:19.617651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:19.623129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 469/957] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:19.666348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825b54-18a1-4773-8401-f288cdbae70d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:19.706695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:19.707625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:19.708051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:19.708470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:19.709259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:19.709991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:19.711558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:19.721978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 489/958] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:19.727792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.843743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91099b02-02cb-4a82-83b1-24b3a6ca1870 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:19.845607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:19.882140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:19.883033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:19.883501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:19.883941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:19.884726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:19.885192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:19.886693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385aa17-c94a-4dbb-9a80-bbabf777ea1b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:19.892403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 470/959] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:19.900586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:19.922697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:20.019881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39341-225b-434f-803c-5c0620ec1cde None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:20.058571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45877129-ad8a-4aa3-9daf-abcf9247f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:20.059498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45877129-ad8a-4aa3-9daf-abcf9247f239 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:20.059953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45877129-ad8a-4aa3-9daf-abcf9247f239 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:20.060393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45877129-ad8a-4aa3-9daf-abcf9247f239 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:20.061229 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45877129-ad8a-4aa3-9daf-abcf9247f239 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:20.062807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45877129-ad8a-4aa3-9daf-abcf9247f239 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:20.141271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 490/960] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:21.307213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9842a-637a-4942-af97-0fe4048c3c31 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.307795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9842a-637a-4942-af97-0fe4048c3c31 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.307795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9842a-637a-4942-af97-0fe4048c3c31 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.309542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 471/961] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:21.315850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.316280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.316465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.341476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:21.342682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:21.380151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576803-371b-4c8a-be9b-78c5a3a58e2d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.380465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576803-371b-4c8a-be9b-78c5a3a58e2d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.380747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576803-371b-4c8a-be9b-78c5a3a58e2d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.382321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 472/962] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:21.387710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.388288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.388765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.408124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:21.410163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:21.418802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:21.429779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 491/963] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:21.489011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 473/964] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:21.733787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:21.777736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:21.863307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58e2b-2a55-4c94-810f-59538fe14531 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:21.900265 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:21.900885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.901200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.901477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.902124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:21.903660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:21.908848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:21.917217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b11b77-748d-46c8-8ee3-ce0ec3a5e9d5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:21.953780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:21.954397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.954681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.954960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.965356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.sql.core [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 14:29:21.965356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 14:29:21.965356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [parameters: {'user_id': '208a2ff41edd4e5c8c739e77450cb384', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 14:29:21.965356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81763) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 14:29:21.968325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-d18e621b-5095-4023-bae3-f5421caa89ae None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Sep 07 14:29:21.972700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 14:29:21.973882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application yield resource Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application next(self.gen) Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise self.value Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application session.commit() Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 14:29:21.975445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.session.flush() Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application compat.raise_( Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 14:29:21.976561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 14:29:21.977505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application conn.query(q) Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application result.read() Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 14:29:21.980182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [parameters: {'user_id': '208a2ff41edd4e5c8c739e77450cb384', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:21.982325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 14:29:21.984379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 14:29:21.992166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 14:29:21.992166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 14:29:21.992166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 14:29:21.992166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 14:29:21.992166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 14:29:21.992166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:21.992755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:21.993841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:21.994932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:21.995821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 492/965] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Sep 7 14:29:21 2022] POST /identity/v3/users => generated 160 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:21.995821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe559-9dd6-469c-83c3-0165b6ee58a4 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:21.995821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe559-9dd6-469c-83c3-0165b6ee58a4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:21.995821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe559-9dd6-469c-83c3-0165b6ee58a4 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:21.996135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 474/966] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Sep 7 14:29:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:21.996240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 493/967] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:21.996334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:21.996419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe559-9dd6-469c-83c3-0165b6ee58a4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.069855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.124585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4849b-4017-4179-82f7-c4ff587caa2a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.130962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe559-9dd6-469c-83c3-0165b6ee58a4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.164336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.164977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.165262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.165537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.167167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.167797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.168079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.168357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.169017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:22.169321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.170801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef464d-6d7b-4690-93e3-46fa8dc7d895 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.173675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.175766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.184556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 494/968] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:29:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:22.184556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.184556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.184556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:22.191392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:22.192615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:22.193607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 475/969] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:29:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:22.194233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.204285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:22.206485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:22.217856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.285266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 495/970] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:22.287737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.328994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241555a-c38b-4a25-9709-4100ee25f767 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.368544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.369373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.369755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.370130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.371669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.382160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.384281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e0eedc02-07e4-49db-9a66-94fb45a2c519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:22.399686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:22.400686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:22.401631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:22.401631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:22.401631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:22.401631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 476/971] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:22.402583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9460-d0d6-44a2-ada5-a15592062433 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.402869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9460-d0d6-44a2-ada5-a15592062433 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.403146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9460-d0d6-44a2-ada5-a15592062433 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.404449 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 477/972] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:22.406241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e9460-d0d6-44a2-ada5-a15592062433 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.435193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d59c-100a-4d70-b4dc-bea0ee7633d7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.474291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.475177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.475688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.475960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.476651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:22.476952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.478379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b91b-7a7b-43d7-96c9-8cb5b893b53a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.482676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.513607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 496/973] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Sep 7 14:29:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:22.515253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.515641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.515992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.530631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e9460-d0d6-44a2-ada5-a15592062433 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.537737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:22.539271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:22.573242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.574039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.574319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.574952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.575950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:22.576263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.577674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.593819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 478/974] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:22.595022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.629592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 497/975] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:22.630710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.673124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.745358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cf606-4f3c-4174-bd76-dd075564e2e8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.768003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae4a9d-9051-4bf7-adc1-911ce0323761 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:22.774607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.785998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.785998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.785998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.785998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.786588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.787165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.818806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:22.818806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:22.818806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:22.818806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:22.825600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:22.826497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:22.841107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:22.847462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:22.848454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 498/976] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:29:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:22.851529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.873881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 479/977] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:29:22 2022] POST /identity/v3/services => generated 242 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:22.913933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:22.982839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:22.989983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf8f7f-3ac3-47d2-8d56-f2a5e54a7a45 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.037230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.037849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.038027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef1346-a425-413e-9738-62892f9f3d09 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.038171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.038390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.039129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:23.039539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.040909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.061544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 499/978] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Sep 7 14:29:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:23.067128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.080785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.081930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.082411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.082753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.083582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.085289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:23.097943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:23.099256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:23.100377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 480/979] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:23.107427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.157089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:23.182273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93158f4a-da96-431f-93b7-0320168b7641 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.213784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b67d-9801-4980-bcb2-2422d7237295 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.221321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.221813 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.222098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.222371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.242169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:23.253634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.258324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.258324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.258324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.258324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:23.258324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.258324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.262954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 481/980] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:23.270875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.296996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.298433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.382030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc4a28-d30c-4fec-a57c-9603792f4f55 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.396137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:23.406684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 500/981] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 14:29:23.412549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.424705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.425332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.425604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.425875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.426507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:23.426810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.428195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.433240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 482/982] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:23.439183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.465136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:23.521360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8f5b-a986-4727-a316-19e265dd7ec0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.552259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b3349-62b9-411d-807a-f24aab6a7c5d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.564088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.565029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.565584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.565962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.576555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.578027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.589500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.590241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.590625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.591004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.591842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] RBAC: Adding query filter params (interface=admin, service_id=6c3374bab05544db93ce05759cbdbaff, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:23.592253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:23.593595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:23.594690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:23.596531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:23.596531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:23.596531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:23.596746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.599987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 501/983] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:23.601159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.608043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 483/984] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/endpoints?service_id=6c3374bab05544db93ce05759cbdbaff&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:23.608685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.654042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:23.718034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951995a-d7a6-48e0-90f5-36aebf317a69 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.718502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228616f6-802f-4c00-9907-3c822cb93016 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.719595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:23.753368 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.753979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.754263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.754537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.755178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:23.755523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.756889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.758175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.759083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.759648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.760122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.760922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.762450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.769730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 502/985] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:23.775407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 484/986] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:29:23.775577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:23.898303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd68c-db5b-42fa-8bf6-5f104b5e10ed None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:23.944144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:23.944789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:23.945066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:23.945340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:23.952678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:23.954114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:23.967398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:23.968537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:23.969659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 503/987] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:23.976810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:24.080895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e98d-5041-41db-ab2a-2806c9583615 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:24.083421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:24.117306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:24.117918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:24.118200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:24.118475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:24.119165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:24.119503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:24.121154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b301ab1-3ad3-485e-a453-2ea36d65f24b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:24.135411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 485/988] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:24.140103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:24.166707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:24.248823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5a60d-9ff6-4ec2-8e80-7c260238e948 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:24.285009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:24.285676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:24.285897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:24.286174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:24.286900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] RBAC: Adding query filter params (role.id=bdeb1c5206ef45f291c45c4d1523862e, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=279a7226767e4381be66397afd481061) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:24.287211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:24.288678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26c38b-8448-4947-9a8d-dac663e95dff None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:24.294882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 504/989] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:24 2022] GET /identity/v3/role_assignments?user.id=279a7226767e4381be66397afd481061&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=bdeb1c5206ef45f291c45c4d1523862e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:25.121470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba926a24-66f4-4545-a5d8-2dbbde947f55 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:25.121984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba926a24-66f4-4545-a5d8-2dbbde947f55 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:25.122064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba926a24-66f4-4545-a5d8-2dbbde947f55 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:25.123404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 486/990] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:25.129428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:25.129883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:25.130052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:25.148866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:25.150039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:25.219924 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 505/991] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:25.493805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba926a24-66f4-4545-a5d8-2dbbde947f55 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:25.623462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba926a24-66f4-4545-a5d8-2dbbde947f55 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:25.660887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:25.661511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:25.661789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:25.662060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:25.662640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:25.664031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:25.673059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:25.674146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:25.675010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:25.676655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 487/992] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:25.680317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:25.699539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:25.793169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebe5c-0230-41a1-9c16-fb1dd4fdabfc None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:25.836832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:25.837447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:25.837727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:25.838000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:25.838629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:25.838934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:25.840332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a1005-aa64-4820-9f63-f7e75368accb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:25.850731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 506/993] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:25.852051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:25.889503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:25.983404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87390088-f1a1-489f-949c-4394cebe9164 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:26.031935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:26.032554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.032840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.033865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.034733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:26.035047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:26.036456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:26.039708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cf34b-9ea9-44da-9495-8652d9baa927 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.039999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cf34b-9ea9-44da-9495-8652d9baa927 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.040279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cf34b-9ea9-44da-9495-8652d9baa927 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.041767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 507/994] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:26.048502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 488/995] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:26.048651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.048651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.048651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.049289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:26.065203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:26.066398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:26.143937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 508/996] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:26.156036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:26.166101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01452e-42fb-4e9c-9af6-14a32320ac2a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:26.202569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:26.203178 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.203487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.203764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.204459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] RBAC: Adding query filter params (interface=public, service_id=21295835935446ceb7f7829829d2bfe0, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:26.204777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:26.207023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:26.212924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 489/997] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:29:26 2022] GET /identity/v3/endpoints?service_id=21295835935446ceb7f7829829d2bfe0&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:26.218557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:26.231551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:26.323699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c20d-485c-400f-86b5-3523d367da7c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:26.358950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9297c49-72c0-4645-8fd6-5c6fe777747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:26.359597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9297c49-72c0-4645-8fd6-5c6fe777747f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.359880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9297c49-72c0-4645-8fd6-5c6fe777747f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.360151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9297c49-72c0-4645-8fd6-5c6fe777747f None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.360754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9297c49-72c0-4645-8fd6-5c6fe777747f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:26.363131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9297c49-72c0-4645-8fd6-5c6fe777747f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:26.369668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 509/998] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:29:26 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:29:26.423899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:26.542527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794cf6-7b5f-45ff-ad92-7f25f88465da None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:26.576415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43156-bd59-40c6-a635-277d06a44c20 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.576634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43156-bd59-40c6-a635-277d06a44c20 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.576905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43156-bd59-40c6-a635-277d06a44c20 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.578245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 510/999] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:26.581960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:26.582686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.582974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.583246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.583746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.583849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:26.584035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.584310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.585480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:26.596739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:26.598547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:26.599450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 490/1000] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Sep 7 14:29:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:26.605018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:26.605279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:26.606458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:26.631497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:26.695958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 511/1001] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:26.734855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133664c8-594d-446d-baaf-17802eadbc3c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:26.780494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:26.781117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.781403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.781684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.782325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:26.782700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:26.784962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:26.795094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 491/1002] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:26.796377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:26.800094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:26.908687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56229a6-d20f-4885-a483-2d6a32e5edaa None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:26.948907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:26.949859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:26.950350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:26.950815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:26.951673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:26.952190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:26.953817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:26.960312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 512/1003] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Sep 7 14:29:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:26.965711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:26.969791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:27.045025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:27.087642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:27.089333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20a03-1a69-4ef0-b456-0da8a3b3bada None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:27.106583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d8d65-d932-49a5-a442-fd7104fab568 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:27.134128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:27.134774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:27.135058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:27.135330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:27.135947 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:27.137320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:27.147048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:27.148599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:27.149526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 513/1004] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Sep 7 14:29:26 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:27.151408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:27.152423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:27.152991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:27.153508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:27.154171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:27.154674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:27.157254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:27.263097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f453-9d7b-4fa4-a300-09faba0a61e9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:27.283721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 492/1005] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:27.302703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:27.315551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:27.316293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:27.316573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:27.316844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:27.317485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] RBAC: Adding query filter params (name=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:27.317788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:27.319188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dff20-0046-44ca-8043-37ead411e761 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:27.324675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 514/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:27.331989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:27.449650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222428ff-8e49-4618-8145-8f49907b5f0c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:27.485240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:27.487132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:27.487132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:27.487132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:27.488228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] RBAC: Adding query filter params (type=image) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:27.488228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:27.489234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e930f4-235f-41a8-a671-5f6baeb6da1b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:27.494504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 493/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:28.605391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c1f28-0e4f-4d7a-8f24-2821691631c7 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:28.605933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c1f28-0e4f-4d7a-8f24-2821691631c7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:28.605933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c1f28-0e4f-4d7a-8f24-2821691631c7 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:28.607427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 515/1008] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:28.612762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:28.613183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:28.613363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:28.632162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:28.633337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:28.635760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:28.703924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 494/1009] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:28.971591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c1f28-0e4f-4d7a-8f24-2821691631c7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:29.075670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c1f28-0e4f-4d7a-8f24-2821691631c7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:29.115184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:29.115845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.116126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.116396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] PATH_INFO: `/v3/services/compute` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.116979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:29.118390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:29.127557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:29.128600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 14:29:29.129578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:29.131705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 516/1010] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:29.134535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:29.238795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c61340-bfa3-4feb-a25f-d21a05209a79 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:29.273456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:29.274068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.274347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.274619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.275248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:29.275579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:29.276961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:29.287008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 495/1011] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:29.287995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:29.349098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:29.393082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2dfb0-514f-43f5-ae87-030b302f5aad None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:29.428623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:29.429256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.429535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.429806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.430604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:29.430911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:29.432513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01530f-423a-4f13-8bb9-6074e46bf7e9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:29.444191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 517/1012] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Sep 7 14:29:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:29.445040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:29.447998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:29.549255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0610b8-d11a-4aa9-a9ac-2fc11b7f82eb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:29.556739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a21d6-03cd-49d6-b4b8-5658d76ef671 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.557027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a21d6-03cd-49d6-b4b8-5658d76ef671 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.557308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a21d6-03cd-49d6-b4b8-5658d76ef671 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.558788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 518/1013] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:29.563666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264094-3bec-4339-966e-ec8cce9a08e7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.563957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264094-3bec-4339-966e-ec8cce9a08e7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.564795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264094-3bec-4339-966e-ec8cce9a08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.585511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e7264094-3bec-4339-966e-ec8cce9a08e7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:29.587012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e7264094-3bec-4339-966e-ec8cce9a08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:29.594616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb38efa-ecd2-4342-8427-ed1d05b30898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:29.595837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb38efa-ecd2-4342-8427-ed1d05b30898 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.596310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb38efa-ecd2-4342-8427-ed1d05b30898 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.596680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb38efa-ecd2-4342-8427-ed1d05b30898 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.597488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb38efa-ecd2-4342-8427-ed1d05b30898 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:29.598987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb38efa-ecd2-4342-8427-ed1d05b30898 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:29.665008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 519/1014] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:29.679599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 496/1015] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:29:29.711874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94360080-50c3-46c0-86d8-deeeff58cf05 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.712149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94360080-50c3-46c0-86d8-deeeff58cf05 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.712423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94360080-50c3-46c0-86d8-deeeff58cf05 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.713785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 520/1016] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:29.719690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:29.719975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:29.720297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:29.740886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:29.742360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:29.806094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:29.828270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 497/1017] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:29 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:29.940251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94360080-50c3-46c0-86d8-deeeff58cf05 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:29.998244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:30.051271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94360080-50c3-46c0-86d8-deeeff58cf05 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:30.086632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:30.087186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:30.087493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:30.087771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:30.088877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:30.090386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:30.092143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 521/1018] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:30.098252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:30.100833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:30.206512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849712d1-5cb1-40f6-9cc5-31b717fc9311 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:30.212706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154ffe5-51d9-4fca-b632-8c576d1848ab None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:30.232285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:30.246833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da929531-c044-4fcf-85d1-a9d116ae693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:30.247734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da929531-c044-4fcf-85d1-a9d116ae693f None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:30.248017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da929531-c044-4fcf-85d1-a9d116ae693f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:30.248296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da929531-c044-4fcf-85d1-a9d116ae693f None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:30.249018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da929531-c044-4fcf-85d1-a9d116ae693f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:30.250454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da929531-c044-4fcf-85d1-a9d116ae693f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:30.250999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970d91d-74f5-4e81-9cd3-295bad882645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:30.251838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d91d-74f5-4e81-9cd3-295bad882645 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:30.252202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d91d-74f5-4e81-9cd3-295bad882645 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:30.252481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d91d-74f5-4e81-9cd3-295bad882645 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:30.253254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970d91d-74f5-4e81-9cd3-295bad882645 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:30.254603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970d91d-74f5-4e81-9cd3-295bad882645 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:30.366474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 522/1019] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:29:30 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:30.396450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 498/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:29:30 2022] POST /identity/v3/projects => generated 311 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:29:32.021539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466f8a3-7327-42af-beea-91fdfa1e1eb8 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.022051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466f8a3-7327-42af-beea-91fdfa1e1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.022156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466f8a3-7327-42af-beea-91fdfa1e1eb8 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.023490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 523/1021] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:32.028721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.029141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.029312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.047908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:32.049921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:32.080567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:32.130940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 499/1022] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:32.409908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466f8a3-7327-42af-beea-91fdfa1e1eb8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:32.518420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466f8a3-7327-42af-beea-91fdfa1e1eb8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:32.559609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3309-3071-4865-967b-aba0b9c3dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:32.560269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3309-3071-4865-967b-aba0b9c3dd06 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.560550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3309-3071-4865-967b-aba0b9c3dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.560824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3309-3071-4865-967b-aba0b9c3dd06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.574352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3309-3071-4865-967b-aba0b9c3dd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-017f3309-3071-4865-967b-aba0b9c3dd06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:32.579329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:32.580450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:32.581317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:32.582659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 524/1023] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Sep 7 14:29:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:32.587097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:32.653624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257582f-8e36-4b7d-bacf-5ff434271913 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.653916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257582f-8e36-4b7d-bacf-5ff434271913 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.654334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257582f-8e36-4b7d-bacf-5ff434271913 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.656061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 525/1024] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:32.661948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff627066-341e-47e4-a727-747a8f051d7d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.662174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff627066-341e-47e4-a727-747a8f051d7d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.662449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff627066-341e-47e4-a727-747a8f051d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.681607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ff627066-341e-47e4-a727-747a8f051d7d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:32.682803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ff627066-341e-47e4-a727-747a8f051d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:32.691426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7468cd-8191-43a2-b443-c432c1c7c389 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:32.714533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:32.727385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:32.728035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.728367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.728567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.729237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:32.729546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:32.730918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088193-e277-42a2-b59b-4fe31cb27700 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:32.739212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 500/1025] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:29:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:32.740659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee998c72-0871-493f-9e1e-5a06cb096ce8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.740965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee998c72-0871-493f-9e1e-5a06cb096ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.741248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee998c72-0871-493f-9e1e-5a06cb096ce8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.742470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 501/1026] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:32.744891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee998c72-0871-493f-9e1e-5a06cb096ce8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:32.755271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 526/1027] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:32.756942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.756942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.757235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.774176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:32.776839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:32.779158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:32.858870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee998c72-0871-493f-9e1e-5a06cb096ce8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:32.864157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 527/1028] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:32.900048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:32.900686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:32.900971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:32.901247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:32.912827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:32.914180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:32.933830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:32.939052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:32.940372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:32.940372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:32.940372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:32.940372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 502/1029] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:32.941017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.026750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.044949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.049387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cc7e5-fa77-46df-94f4-788ca8852470 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.087898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.088754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.089036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.089301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.089943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:33.090244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.091626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.102988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 528/1030] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:33.108418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.117770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.143050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d835-0a33-47bd-b5d7-d5e4e0b4ed3c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.179546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.180110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.180399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.180673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] PATH_INFO: `/v3/services/image` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.181250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.182614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:33.191667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:33.192739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:33.193628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:33.197671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 503/1031] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:33.198499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.210702 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f95c-fbfa-4167-b000-6fad26de0ffb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.245450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.246078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.246360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.246634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.255193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.256673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:33.268603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:33.269805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 529/1032] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:33.271087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.289504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.312550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fe6c-e2d4-4c2f-af4f-ade76c59fabd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.351199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.351866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.352150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.352426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.353566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.354992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.356576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 504/1033] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:33.357340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.369493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.377648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923913e-c16a-47bd-9538-9e56ecd8ce38 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.411548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.412180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.412463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.412739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.413367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] RBAC: Adding query filter params (name=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:33.413677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.415036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.425679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 530/1034] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:33.425679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.460989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af0c1-1cce-4981-8c9a-f16471bf61d0 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.495115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.495751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.496040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.496321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.497048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:33.497358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.498782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.505409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.516108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 505/1035] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:33.533873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.534040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba83218-4e62-41d5-ad06-e0659086d9fa None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.559270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.559912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.560192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.560467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.561106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.562530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.585743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.622938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94199cd-e1dd-4e5f-b991-40e5088dffe4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.662556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 531/1036] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:29:33 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:33.664336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.666700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.667403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.667699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.667971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.668622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] RBAC: Adding query filter params (type=image) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:33.668927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.670361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.682015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 506/1037] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:33.683146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.791837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5447d5-28ae-4f04-9ed9-2e87c11f0f50 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.808597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b7de-0245-42d0-a065-8dced4c8b16c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:33.831580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.832209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.832488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.832765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.843876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.844721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:33.852045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:33.852668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:33.859383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:33.859383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:33.859383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] RBAC: Adding query filter params (interface=public, service_id=871d51c9215244d5a13c8fa98b130cf5, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:33.859383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.859383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.861740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 507/1038] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/endpoints?service_id=871d51c9215244d5a13c8fa98b130cf5&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:33.867315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:33.916117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:33.917860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:33.991513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1f7b8-b9dc-4713-a747-ea60f770b581 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:34.029962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:34.030723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:34.031008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:34.031292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:34.031922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:34.033435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:34.042670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 532/1039] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:34.043783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 508/1040] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:29:33 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:29:34.044770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:34.089448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:34.157174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fca00-3fad-4a4b-a92e-5d0b3f4f8f37 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:34.195956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:34.196602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:34.196879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:34.197146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:34.209773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:34.211228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:34.227097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:34.228280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:34.229200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:34.229200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:34.229200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:34.229200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 533/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:34.234594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:34.297560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:34.352110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044f996-fb1f-48b9-a07f-03993608fdaa None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:34.386829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:34.387467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:34.387756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:34.388035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:34.388686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:34.388995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:34.390363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:34.407191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 509/1042] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:34.408453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:34.504081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:34.520309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27748058-7858-4e55-bbfa-016f8973700c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:34.558419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:34.559026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:34.559315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:34.559616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:34.567309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:34.568772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:34.580199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:34.581116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:34.582055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 534/1043] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:34.588898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:34.696210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cdb7-b16a-426b-bbdb-9de2963ce131 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:34.713847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:34.731763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:34.732402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:34.732686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:34.732965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:34.733656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:34.733967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:34.735402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fba3a-975e-49ad-9204-47169878b073 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:34.753501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 510/1044] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:34.754980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:34.861892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed1be2-f1f5-4c6a-ac99-b6626cda7a3a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:34.895451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:34.896061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:34.896340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:34.896612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:34.897339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] RBAC: Adding query filter params (role.id=bdeb1c5206ef45f291c45c4d1523862e, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=2c129868b68642ccab8686ed6fe22906) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:34.897650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:34.899077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23acd6-088d-4db7-ab49-bb52a2febc1e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:34.911394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 535/1045] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:34 2022] GET /identity/v3/role_assignments?user.id=2c129868b68642ccab8686ed6fe22906&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=bdeb1c5206ef45f291c45c4d1523862e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:35.948090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3beb-f40f-438f-8bbe-d92c2618742b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:35.948637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3beb-f40f-438f-8bbe-d92c2618742b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:35.948637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3beb-f40f-438f-8bbe-d92c2618742b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:35.949981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 511/1046] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:35.956163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1926415-27bb-4471-ad43-b60ab0a2a402 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:35.956586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1926415-27bb-4471-ad43-b60ab0a2a402 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:35.956764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1926415-27bb-4471-ad43-b60ab0a2a402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:35.976221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d1926415-27bb-4471-ad43-b60ab0a2a402 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:35.977403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d1926415-27bb-4471-ad43-b60ab0a2a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:35.986837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:36.047418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 536/1047] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:36.290944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983d727-9173-4daf-88f1-653c6eb5cf63 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.291323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983d727-9173-4daf-88f1-653c6eb5cf63 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.291545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983d727-9173-4daf-88f1-653c6eb5cf63 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.293014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 512/1048] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:36.298165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.298577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.299036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.317887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:36.319143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:36.320103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983d727-9173-4daf-88f1-653c6eb5cf63 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:36.389770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 537/1049] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:36.428522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983d727-9173-4daf-88f1-653c6eb5cf63 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:36.463019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:36.463841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.464132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.464413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.475007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:36.479887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:36.480914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:36.482102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 513/1050] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:36.487822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:36.565979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:36.592407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91aca2-d95b-42be-b3d8-7a6dfcfb83f8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:36.627847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:36.628460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.628745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.629115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.629790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:36.630098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:36.631513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:36.645682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 538/1051] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:36.647465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:36.666382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:36.690470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:36.758079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53589a5-e404-4e33-b94e-b40f55660437 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:36.775083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb245d-87b8-4de2-944d-e7283f45f4ca None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:36.794482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:36.795123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.795440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.795726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] PATH_INFO: `/v3/users/2c8c07127e0a404c8ece3efdcff37c16` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.810030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] RBAC: Authorizing `identity:get_user(user_id=2c8c07127e0a404c8ece3efdcff37c16)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:36.811504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:36.813423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 514/1052] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:36 2022] GET /identity/v3/users/2c8c07127e0a404c8ece3efdcff37c16 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:36.814682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:36.815292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.815601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.815873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] PATH_INFO: `/v3/services/image` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.816512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:36.817818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:36.819615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:36.821034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:36.828615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:36.830105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:36.831709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 539/1053] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Sep 7 14:29:36 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:36.837247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:36.945420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:36.951346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b0dd-318a-490f-a5de-e7e225623f73 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:36.952051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddbaff-7d12-4710-8da5-8718140b851b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:36.994568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:36.995256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.995509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.995749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.996156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8446db-378f-43a6-8ae6-867877a74a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:36.996382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] RBAC: Adding query filter params (name=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:36.996684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:36.996867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8446db-378f-43a6-8ae6-867877a74a94 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:36.997130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8446db-378f-43a6-8ae6-867877a74a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:36.997410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8446db-378f-43a6-8ae6-867877a74a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:36.998051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.007837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 540/1054] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:37.009950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:37.074999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8446db-378f-43a6-8ae6-867877a74a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:37.076474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8446db-378f-43a6-8ae6-867877a74a94 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.083794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:37.123458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acc59-2326-48fd-b14d-0b469c8ded2a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:37.160866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:37.161469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.161753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.162029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.162664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] RBAC: Adding query filter params (type=image) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:37.162981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:37.164401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23144a9-233b-4d29-9e68-828eebdce56e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.169521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 541/1055] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:37.172471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd61f9-a885-445c-a865-5547d4f797eb None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.172471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd61f9-a885-445c-a865-5547d4f797eb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.172471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd61f9-a885-445c-a865-5547d4f797eb None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.172743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 542/1056] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:37.178489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd61f9-a885-445c-a865-5547d4f797eb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:37.199111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:37.205940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 515/1057] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 14:29:37.205940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.205940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.205940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.226366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:37.227591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:37.285671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd61f9-a885-445c-a865-5547d4f797eb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:37.299789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 516/1058] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:37.300684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:37.313293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:37.321884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:37.322546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.342774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.342774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.342774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:37.342774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.406151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1665-61e2-4202-bfd2-0aaf22f1f760 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:37.421891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 543/1059] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:29:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:37.436168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:37.456382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:37.457040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.457322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.457591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.458821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] RBAC: Authorizing `identity:get_project(project_id=422913e1cddb496abc5d578814677817)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:37.460576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.462520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 517/1060] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:29:37 2022] GET /identity/v3/projects/422913e1cddb496abc5d578814677817 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:37.468538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:37.583839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:37.592696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cdfc1-738f-4d5d-bf2a-8a42d86c00b1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:37.634085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:37.634085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.634085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.634435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.635074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=422913e1cddb496abc5d578814677817, user.id=2c8c07127e0a404c8ece3efdcff37c16) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:37.635827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:37.637376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.642950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 544/1061] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:37 2022] GET /identity/v3/role_assignments?user.id=2c8c07127e0a404c8ece3efdcff37c16&scope.project.id=422913e1cddb496abc5d578814677817&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:37.726132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df4e9d-ea7d-4157-937c-baea8fa70d6a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:37.764791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:37.765441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.765723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.765997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.778521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:37.784117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:37.785119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:37.786437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 518/1062] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Sep 7 14:29:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:37.791764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:37.847121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:37.907155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771124-9eb5-407c-90ab-c823b4145cb9 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:37.949712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:37.950324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:37.950604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:37.950900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:37.951557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:37.951858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:37.953207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:37.962040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 545/1063] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:37.967474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:38.022538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:38.072635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894da9b-beab-4eca-a7a1-b1f14bd9e35d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:38.107226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:38.107883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:38.108166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:38.108440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:38.119522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:38.120944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:38.137430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:38.138503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:38.140121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:38.140121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:38.140121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:38.145308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 519/1064] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:38.145437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:38.250608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2226b-a4b4-4736-999f-fd8aa468bb95 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:38.261380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:38.288166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:38.289201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:38.289719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:38.289988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:38.290636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:38.290942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:38.292373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:38.306893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 546/1065] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:38.312447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:38.429094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406a3a-b5a7-4b00-91a3-b9e4028463d5 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:38.430615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:38.475538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:38.476170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:38.476455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:38.476729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:38.483942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:38.485370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:38.498689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:38.499916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:29:38.501123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:38.503695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 520/1066] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:38.506080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:38.616035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7262-b089-42c5-9487-b59d7ec6d793 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:38.650167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:38.650782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:38.651066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:38.651346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:38.652108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:38.652418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:38.653852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:38.672333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 547/1067] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:29:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:38.678942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:38.831056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b681c-0943-415e-98c7-8e4e571ed791 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:38.867216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:38.867878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:38.868158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:38.868433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:38.879566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:38.881003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:38.896071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:38.897104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:38.898647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:38.898647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:38.898647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:38.898647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 521/1068] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:38.903503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:38.945591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:39.021915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13babff-f6c0-4cf7-bc2f-6335bc270e02 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:39.057331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:39.057935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.058213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.058480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.059319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:39.059738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:39.061110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:39.079816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 548/1069] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:39.082388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:39.100017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:39.186793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec888c9-b5c3-4209-95b6-10244aa75391 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:39.222810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:39.223473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.223760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.224036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.231211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:39.232713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:39.244273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:39.245756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:39.247039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:39.250251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 522/1070] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:39.251828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:39.348245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:39.361525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fe76-162e-4dd1-9412-e54b5ee0d1fd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:39.397694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:39.398308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.398586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.398858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.399575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:39.399883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:39.401361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524eb87-0c4c-4de1-a2e8-72f087d12981 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:39.414754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 549/1071] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:39.420490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:39.500538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:39.534446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0188b-b1d8-47f7-a4db-488d50944698 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:39.571889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ca56-b3b4-4b5c-a87c-caad3f65dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:39.572757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ca56-b3b4-4b5c-a87c-caad3f65dc02 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.573181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ca56-b3b4-4b5c-a87c-caad3f65dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.573590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ca56-b3b4-4b5c-a87c-caad3f65dc02 None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/2c129868b68642ccab8686ed6fe22906/roles/bdeb1c5206ef45f291c45c4d1523862e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.576164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ca56-b3b4-4b5c-a87c-caad3f65dc02 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=2c129868b68642ccab8686ed6fe22906, role_id=bdeb1c5206ef45f291c45c4d1523862e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:39.577849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ca56-b3b4-4b5c-a87c-caad3f65dc02 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:39.693582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3c9c-4676-485f-b650-329beda3df37 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.693768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3c9c-4676-485f-b650-329beda3df37 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.694047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3c9c-4676-485f-b650-329beda3df37 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.695525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 550/1072] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:39.700706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127986dd-9160-48d5-980b-6f3953e1f8d2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.706081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127986dd-9160-48d5-980b-6f3953e1f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.706081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127986dd-9160-48d5-980b-6f3953e1f8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.708540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 523/1073] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:29:39 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/2c129868b68642ccab8686ed6fe22906/roles/bdeb1c5206ef45f291c45c4d1523862e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:29:39.722786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-127986dd-9160-48d5-980b-6f3953e1f8d2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:39.724089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-127986dd-9160-48d5-980b-6f3953e1f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:39.810992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 551/1074] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:39.871182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d91e-9561-4a59-8102-e15dd5d961de None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.871614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d91e-9561-4a59-8102-e15dd5d961de None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.871843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d91e-9561-4a59-8102-e15dd5d961de None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.873313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 524/1075] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:39.879108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:39.879646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:39.880027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:39.899876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:39.901128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:39.982920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 552/1076] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:40.092314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d91e-9561-4a59-8102-e15dd5d961de None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.206240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d91e-9561-4a59-8102-e15dd5d961de None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:40.244583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:40.245114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:40.245397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:40.245670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:40.248353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:40.253172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.263299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:40.324597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:40.326672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:40.371477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bec097-17ab-42d6-8ccf-2a43ce45245c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:40.413179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:40.414191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:40.414653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:40.415112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:40.433642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:40.442697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:40.444596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:40.445729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 553/1077] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:40.451526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.465084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 525/1078] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:40.470991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.510209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:40.542452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:40.590075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18bbb4-bd10-4092-9003-eec679571858 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:40.594660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d3ef-bffa-4246-a3e0-3b7e054da521 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:40.628629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:40.629257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:40.629532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:40.629805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:40.630493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:40.630811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:40.632251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:40.635296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:40.636139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:40.636646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:40.637080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:40.641458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 554/1079] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:40.648243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.651115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:40.652885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:40.669649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:40.670826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:40.671876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:40.671876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:40.671876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:40.675408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 526/1080] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:40.678647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.774510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd16ae-d241-4cf0-b8a4-88a73a51a556 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:40.789441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:40.803633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:40.804750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072f169-4fbd-47b4-a1d7-600b5461efe4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:40.809855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:40.810309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:40.810589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:40.810863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] PATH_INFO: `/v3/users/2c8c07127e0a404c8ece3efdcff37c16` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:40.812074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] RBAC: Authorizing `identity:get_user(user_id=2c8c07127e0a404c8ece3efdcff37c16)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:40.814048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:40.815715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 555/1081] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/users/2c8c07127e0a404c8ece3efdcff37c16 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:40.821380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:40.855961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:40.855961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:40.855961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:40.855961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:40.856442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:40.856442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:40.857525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:40.869940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 527/1082] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:40.989066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6999a9-94af-4654-8f13-a95861e8b131 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:41.027992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d52d-9af4-409b-b225-048d46df0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:41.028556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d52d-9af4-409b-b225-048d46df0251 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:41.028835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d52d-9af4-409b-b225-048d46df0251 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:41.029107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d52d-9af4-409b-b225-048d46df0251 None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:41.030290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d52d-9af4-409b-b225-048d46df0251 None admin] RBAC: Authorizing `identity:get_project(project_id=422913e1cddb496abc5d578814677817)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:41.032347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d52d-9af4-409b-b225-048d46df0251 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:41.033737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 556/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:29:40 2022] GET /identity/v3/projects/422913e1cddb496abc5d578814677817 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:41.039930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:41.167260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcf3ae-dbd0-463a-92de-58ccd133c4ea None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:41.213531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5ef08-f62e-4867-8d02-2ea722a5acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:41.214207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5ef08-f62e-4867-8d02-2ea722a5acf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:41.214537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5ef08-f62e-4867-8d02-2ea722a5acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:41.214760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5ef08-f62e-4867-8d02-2ea722a5acf2 None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817/users/2c8c07127e0a404c8ece3efdcff37c16/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:41.216697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5ef08-f62e-4867-8d02-2ea722a5acf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=422913e1cddb496abc5d578814677817, user_id=2c8c07127e0a404c8ece3efdcff37c16, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:41.218123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5ef08-f62e-4867-8d02-2ea722a5acf2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:41.328408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 528/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:29:41 2022] PUT /identity/v3/projects/422913e1cddb496abc5d578814677817/users/2c8c07127e0a404c8ece3efdcff37c16/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:29:41.944927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83dabb-9d1e-4679-aa13-66cc0ee85d16 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:41.945482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83dabb-9d1e-4679-aa13-66cc0ee85d16 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:41.945482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83dabb-9d1e-4679-aa13-66cc0ee85d16 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:41.946791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 557/1085] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:41.952085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:41.952375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:41.952653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:41.966832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:41.972307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:41.973487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:42.042371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 529/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:42.319674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83dabb-9d1e-4679-aa13-66cc0ee85d16 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:42.387508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:42.425042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83dabb-9d1e-4679-aa13-66cc0ee85d16 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:42.459145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:42.460057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:42.460340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:42.460612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:42.471720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:42.476416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:42.477940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:42.478828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 558/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Sep 7 14:29:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:42.484516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:42.581372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f2ce6-2210-4a06-8064-49b623bc069e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:42.615916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:42.616525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:42.616807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:42.617080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:42.617744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:42.618047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:42.619516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:42.622021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:42.629343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 530/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:29:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:42.635553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:42.744189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cef2d-adc8-4a3a-81d5-fde9b915c48f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:42.772748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:42.781093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:42.781721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:42.782006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:42.782367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:42.793035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:42.794478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:42.809439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:42.810410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:42.811328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:42.811328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:42.811328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:42.811328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 559/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:42.817475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:42.940231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501bae8-b54c-4cc6-94d0-b91565c3feaa None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:42.974283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:42.974889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:42.975176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:42.975549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:42.976193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:42.976511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:42.977862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:42.990334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 531/1090] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:42.995751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:43.100909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c121-d833-4565-871a-90c08a580f79 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:43.137718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:43.138350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:43.138628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:43.138896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:43.146373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:43.147844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:29:43.159446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:43.161346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 14:29:43.163424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:43.164694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 560/1091] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Sep 7 14:29:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:43.166481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:43.226941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:43.274929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7f335-ca77-4506-b55a-2a3f4a340945 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:43.309531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:43.310133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:43.310413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:43.310682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:43.311421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:43.311730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:43.313133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4593de-7056-4cf2-bcc2-d605ba3067b1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:43.330925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 532/1092] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Sep 7 14:29:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:43.337038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:43.378566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:43.444518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9fcac-48c4-4ef9-8fa3-936d42e59539 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:43.478534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:43.479078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:43.479350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:43.479652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:43.537188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4873-59a5-4278-9486-aa8086da5659 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:43.537746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4873-59a5-4278-9486-aa8086da5659 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:43.537746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4873-59a5-4278-9486-aa8086da5659 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:43.539065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 533/1093] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:29:43.544447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:43.544735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:43.545025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:43.559194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:43.561518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:43.564597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:43.565876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:43.614637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:43.636066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 534/1094] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 14:29:43.678641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 561/1095] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:43.684418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:43.743517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:43.795990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bcb1-7521-4307-9df7-ba4ff33f4744 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:43.830163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:43.830793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:43.831080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:43.831360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:43.841566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:43.842996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:29:43.858055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:43.859031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:29:43.860022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:29:43.860022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:29:43.860022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:43.860022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 535/1096] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:29:43.865580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:43.921917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:43.982058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47acf0-6a24-4999-8453-a821694d601b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.027876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.028562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.028652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.028767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.029038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.029690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:44.029996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.031398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.031887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8dd4-c2be-4244-8a34-e04c38ac75dc None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.038895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.044187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 562/1097] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:44.050402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.070045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.070680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.070966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.073217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.081694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:29:44.086824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:44.087983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:29:44.089340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 536/1098] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:44.093954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.175269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0140-488c-4fad-b5cc-5d364f9b4623 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.208531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732332e3-4158-4dfd-a9ad-acd30084197c None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.211440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.212101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.212380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.212653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.219802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.221598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:29:44.234855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:29:44.236583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:29:44.237612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 563/1099] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:29:44.242909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.245803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.246423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.246709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.246987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.247689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:44.247999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.249359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.263921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 537/1100] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:44.265200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.290108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.303989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.346820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273118cc-0477-44e1-9e7a-ffd05f6e9a42 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.371255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e46714-afec-43de-a28e-42541109a2e8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.382460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.383060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.383341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.383657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.384339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:44.384644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.386072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.400196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 564/1101] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:44.406280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.409274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.409521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.409809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.410092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] PATH_INFO: `/v3/users/2c8c07127e0a404c8ece3efdcff37c16` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.411579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] RBAC: Authorizing `identity:get_user(user_id=2c8c07127e0a404c8ece3efdcff37c16)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.412759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.414344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 538/1102] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/users/2c8c07127e0a404c8ece3efdcff37c16 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:44.419967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.517109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.517458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934057c0-d438-4eb6-b7bc-2d4cc777e7ad None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.530783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10670daf-b948-41c4-8258-b76e021aae08 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.536651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.556080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.556602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.556879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.557145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.557860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] RBAC: Adding query filter params (role.id=bdeb1c5206ef45f291c45c4d1523862e, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=2c129868b68642ccab8686ed6fe22906) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:44.558181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.559690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.566406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 565/1103] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/role_assignments?user.id=2c129868b68642ccab8686ed6fe22906&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=bdeb1c5206ef45f291c45c4d1523862e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:44.570160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.571100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.571657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.572108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.652995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.654474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.760745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:44.774654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 539/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 14:29:44.780565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:44.889061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249625f-9f62-4d95-9510-09c529d6d84c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:44.926600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5bbc3-da84-4d28-a9e4-04548bddb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:44.927250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5bbc3-da84-4d28-a9e4-04548bddb0ce None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:44.927602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5bbc3-da84-4d28-a9e4-04548bddb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:44.927905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5bbc3-da84-4d28-a9e4-04548bddb0ce None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:44.929925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5bbc3-da84-4d28-a9e4-04548bddb0ce None admin] RBAC: Authorizing `identity:get_project(project_id=422913e1cddb496abc5d578814677817)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:44.931354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5bbc3-da84-4d28-a9e4-04548bddb0ce None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:44.933085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 566/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/projects/422913e1cddb496abc5d578814677817 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:44.940520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:45.046242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12cc34-50d9-4f73-a4e7-cd06e3e8d6cf None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:45.084687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:45.085303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:45.085589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:45.085866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:45.086593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=422913e1cddb496abc5d578814677817, user.id=2c8c07127e0a404c8ece3efdcff37c16) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:45.086906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:45.088362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99e940-c415-4ab4-ade3-5b8e378fca5c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:45.095063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 540/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:44 2022] GET /identity/v3/role_assignments?user.id=2c8c07127e0a404c8ece3efdcff37c16&scope.project.id=422913e1cddb496abc5d578814677817&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:47.334057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d072-0fc5-4794-ba6d-57879e6542ba None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:47.334881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d072-0fc5-4794-ba6d-57879e6542ba None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:47.334881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d072-0fc5-4794-ba6d-57879e6542ba None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:47.336283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 567/1107] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:47.341742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:47.342134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:47.342300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:47.362044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:47.363244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:47.411506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:47.431436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 541/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:47.731835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869d072-0fc5-4794-ba6d-57879e6542ba None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:47.791457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:47.845375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869d072-0fc5-4794-ba6d-57879e6542ba None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:47.881102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddbd4c-522d-405d-a699-a0040a96a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:47.881733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddbd4c-522d-405d-a699-a0040a96a519 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:47.882013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddbd4c-522d-405d-a699-a0040a96a519 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:47.882287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddbd4c-522d-405d-a699-a0040a96a519 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:47.883409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddbd4c-522d-405d-a699-a0040a96a519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:47.884884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddbd4c-522d-405d-a699-a0040a96a519 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:47.886477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 568/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:29:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:47.893188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:48.003602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde02cff-7bb4-42ff-a984-dc085da18623 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:48.037919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848575c-6474-4861-a50d-ffa30e52a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:48.038526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848575c-6474-4861-a50d-ffa30e52a2f5 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:48.038808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848575c-6474-4861-a50d-ffa30e52a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:48.039082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848575c-6474-4861-a50d-ffa30e52a2f5 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:48.039762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848575c-6474-4861-a50d-ffa30e52a2f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:48.041190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848575c-6474-4861-a50d-ffa30e52a2f5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:48.126961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 542/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:29:47 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:29:50.346632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb241c-79e4-4785-8b90-de468055671e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:50.347167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb241c-79e4-4785-8b90-de468055671e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:50.347167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb241c-79e4-4785-8b90-de468055671e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:50.348563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 569/1111] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:50.353984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:50.354637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:50.354921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:50.374515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:50.375876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:50.405813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:50.444017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 543/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:50.714678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb241c-79e4-4785-8b90-de468055671e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:50.820001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb241c-79e4-4785-8b90-de468055671e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:50.838626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:50.856596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:50.857225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:50.857503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:50.857774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] PATH_INFO: `/v3/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:50.859147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] RBAC: Authorizing `identity:get_role(role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:50.860712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:50.862031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 570/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:50 2022] GET /identity/v3/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:29:50.868247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:50.990004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cadde3-77f8-4940-b880-e4d85206f562 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:51.024691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:51.025331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:51.025610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:51.025889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] PATH_INFO: `/v3/users/fb983a19349d4852b66c6a1db54756f3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:51.039967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] RBAC: Authorizing `identity:get_user(user_id=fb983a19349d4852b66c6a1db54756f3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:51.041404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:51.043157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 544/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:50 2022] GET /identity/v3/users/fb983a19349d4852b66c6a1db54756f3 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:51.049619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:51.156161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551076-f9d2-4e45-805d-7d2ead7ad99b None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:51.192706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:51.193314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:51.193597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:51.193874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:51.260276 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:51.280305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:51.282917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:51.439336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 571/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:51.445406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:51.474629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:51.549106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada65e6-2fca-47f5-b8ca-74467744e09b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:51.583672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ff1fe-1056-47ef-a3fb-427db0a2f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:51.584556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff1fe-1056-47ef-a3fb-427db0a2f59a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:51.584844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff1fe-1056-47ef-a3fb-427db0a2f59a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:51.585121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff1fe-1056-47ef-a3fb-427db0a2f59a None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:51.586245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ff1fe-1056-47ef-a3fb-427db0a2f59a None admin] RBAC: Authorizing `identity:get_project(project_id=422913e1cddb496abc5d578814677817)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:51.587706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ff1fe-1056-47ef-a3fb-427db0a2f59a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:51.589339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 545/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:29:51 2022] GET /identity/v3/projects/422913e1cddb496abc5d578814677817 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:51.596302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:51.680686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:51.695577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d28e2-a851-4e40-8bcb-570b5a0da0b2 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:51.731268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:51.731906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:51.732184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:51.732486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:51.733203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] RBAC: Adding query filter params (role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=422913e1cddb496abc5d578814677817, user.id=fb983a19349d4852b66c6a1db54756f3) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:51.733509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:51.734966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bc3e1-bf32-4e9a-b4c6-71fa6dc50a43 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:51.741326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 572/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:51 2022] GET /identity/v3/role_assignments?user.id=fb983a19349d4852b66c6a1db54756f3&scope.project.id=422913e1cddb496abc5d578814677817&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:53.908596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f84c2-c315-4500-ab36-be40163056a5 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:53.909130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f84c2-c315-4500-ab36-be40163056a5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:53.909130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f84c2-c315-4500-ab36-be40163056a5 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:53.910482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 546/1118] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:53.915690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:53.916076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:53.916239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:53.935288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:53.936531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:54.005001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 573/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:54.272728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f84c2-c315-4500-ab36-be40163056a5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:54.367958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:54.375533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f84c2-c315-4500-ab36-be40163056a5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:54.409488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:54.410389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:54.410669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:54.410944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] PATH_INFO: `/v3/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:54.412339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] RBAC: Authorizing `identity:get_role(role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:54.413690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:54.414979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 547/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:54 2022] GET /identity/v3/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:54.420852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:54.500974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:54.519921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3cac7-a3cc-4928-b646-b52a41044c09 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:54.554189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:54.554740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:54.555017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:54.555285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] PATH_INFO: `/v3/users/fb983a19349d4852b66c6a1db54756f3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:54.556404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] RBAC: Authorizing `identity:get_user(user_id=fb983a19349d4852b66c6a1db54756f3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:54.557816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:54.559376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 574/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:54 2022] GET /identity/v3/users/fb983a19349d4852b66c6a1db54756f3 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:54.565946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:54.666874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae224d-5265-4c0a-97c3-7d6a174f60ba None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:54.700112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba74095-c398-4452-aeff-50e79469eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:54.700736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba74095-c398-4452-aeff-50e79469eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:54.701024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba74095-c398-4452-aeff-50e79469eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:54.701304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba74095-c398-4452-aeff-50e79469eeb4 None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:54.702409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba74095-c398-4452-aeff-50e79469eeb4 None admin] RBAC: Authorizing `identity:get_project(project_id=422913e1cddb496abc5d578814677817)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:54.704680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba74095-c398-4452-aeff-50e79469eeb4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:54.706086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 548/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:29:54 2022] GET /identity/v3/projects/422913e1cddb496abc5d578814677817 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:54.712506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:54.811605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9ccfd-525c-4c83-ba7c-e391a28007c0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:54.847106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9874a-95ca-43a9-b204-3f584768a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:54.847792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9874a-95ca-43a9-b204-3f584768a809 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:54.848097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9874a-95ca-43a9-b204-3f584768a809 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:54.848372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9874a-95ca-43a9-b204-3f584768a809 None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817/users/fb983a19349d4852b66c6a1db54756f3/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:54.850473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9874a-95ca-43a9-b204-3f584768a809 None admin] RBAC: Authorizing `identity:create_grant(project_id=422913e1cddb496abc5d578814677817, user_id=fb983a19349d4852b66c6a1db54756f3, role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:54.851942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9874a-95ca-43a9-b204-3f584768a809 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:54.949131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 575/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:29:54 2022] PUT /identity/v3/projects/422913e1cddb496abc5d578814677817/users/fb983a19349d4852b66c6a1db54756f3/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:29:57.087904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c371-7165-46bd-aae7-910707fa92ef None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:57.088439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c371-7165-46bd-aae7-910707fa92ef None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:57.088439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c371-7165-46bd-aae7-910707fa92ef None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:57.089784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 549/1124] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:29:57.095601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:57.096025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:57.096146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:57.114465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:29:57.115674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:29:57.117620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:57.186656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 576/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:29:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:29:57.464657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c371-7165-46bd-aae7-910707fa92ef None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:57.495299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:57.567132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c371-7165-46bd-aae7-910707fa92ef None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:57.603235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:57.603895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:57.604180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:57.604457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] PATH_INFO: `/v3/roles/6e4aa7306e3048f7a2c01de5d02b956b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:57.605843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] RBAC: Authorizing `identity:get_role(role_id=6e4aa7306e3048f7a2c01de5d02b956b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:57.607194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:57.608598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 550/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:57 2022] GET /identity/v3/roles/6e4aa7306e3048f7a2c01de5d02b956b => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:57.615609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:57.713837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8266-36eb-4c55-9ca3-c64f5f77ae4f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:57.748156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:57.748705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:57.748982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:57.749250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] PATH_INFO: `/v3/users/fb983a19349d4852b66c6a1db54756f3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:57.750964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] RBAC: Authorizing `identity:get_user(user_id=fb983a19349d4852b66c6a1db54756f3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:57.752426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:57.753990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 577/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:29:57 2022] GET /identity/v3/users/fb983a19349d4852b66c6a1db54756f3 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:57.759830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:57.864501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:57.868463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668626-d7b4-48c3-b409-ac39861693de None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:57.902164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:57.902773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:57.903056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:57.903333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:57.974089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:57.975554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:58.071257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:58.075742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 551/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:29:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:29:58.082025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:58.091097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:29:58.182341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da6ec-1ca5-4360-a283-66a7b526e86a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:58.215803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7290a01-4463-4c79-b7dc-5ba031460a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:58.216429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7290a01-4463-4c79-b7dc-5ba031460a19 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:58.216710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7290a01-4463-4c79-b7dc-5ba031460a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:58.216993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7290a01-4463-4c79-b7dc-5ba031460a19 None admin] PATH_INFO: `/v3/projects/422913e1cddb496abc5d578814677817` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:58.218094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7290a01-4463-4c79-b7dc-5ba031460a19 None admin] RBAC: Authorizing `identity:get_project(project_id=422913e1cddb496abc5d578814677817)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:58.219845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7290a01-4463-4c79-b7dc-5ba031460a19 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:58.221479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 578/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:29:58 2022] GET /identity/v3/projects/422913e1cddb496abc5d578814677817 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:29:58.227911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:29:58.326267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278728b-2ce5-4948-b8f3-463336db4fdd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:29:58.360260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:29:58.360994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:29:58.361272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:29:58.361547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:29:58.362261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] RBAC: Adding query filter params (role.id=6e4aa7306e3048f7a2c01de5d02b956b, scope.project.id=422913e1cddb496abc5d578814677817, user.id=fb983a19349d4852b66c6a1db54756f3) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:29:58.362568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:29:58.364003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ccab2-acd5-473a-ace0-473d02d5a631 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:29:58.369679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 552/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:29:58 2022] GET /identity/v3/role_assignments?user.id=fb983a19349d4852b66c6a1db54756f3&scope.project.id=422913e1cddb496abc5d578814677817&role.id=6e4aa7306e3048f7a2c01de5d02b956b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:00.557931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057cd16-6b65-464a-95a3-f04765a4d588 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:00.558498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057cd16-6b65-464a-95a3-f04765a4d588 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:00.558498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057cd16-6b65-464a-95a3-f04765a4d588 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:00.559864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 579/1131] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:00.565138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:00.565559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:00.565672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:00.584959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:00.586131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:00.641858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:00.651995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 553/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:00.915764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057cd16-6b65-464a-95a3-f04765a4d588 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:00.993849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:01.019071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057cd16-6b65-464a-95a3-f04765a4d588 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:01.053566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2a582-5fa6-4c41-a65e-a3c5186cbc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:01.054183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a582-5fa6-4c41-a65e-a3c5186cbc1f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:01.054466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a582-5fa6-4c41-a65e-a3c5186cbc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:01.054743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a582-5fa6-4c41-a65e-a3c5186cbc1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:01.055874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2a582-5fa6-4c41-a65e-a3c5186cbc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:01.057316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2a582-5fa6-4c41-a65e-a3c5186cbc1f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:01.058987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 580/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:01.065635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:01.161306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad00d8-553a-4a86-8ef1-176f7ea803c2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:01.195301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df253fa9-33ca-4dbd-a8af-48d5e5828d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:01.195870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253fa9-33ca-4dbd-a8af-48d5e5828d70 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:01.196155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253fa9-33ca-4dbd-a8af-48d5e5828d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:01.196431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253fa9-33ca-4dbd-a8af-48d5e5828d70 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:01.197092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df253fa9-33ca-4dbd-a8af-48d5e5828d70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:01.198542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df253fa9-33ca-4dbd-a8af-48d5e5828d70 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:01.316454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 554/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:30:01 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:30:03.555318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc3595-a8ca-48d5-90f9-88c9d500c8a1 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:03.555884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc3595-a8ca-48d5-90f9-88c9d500c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:03.555884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc3595-a8ca-48d5-90f9-88c9d500c8a1 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:03.557219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 581/1135] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:03.562488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:03.562937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:03.563177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:03.583426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:03.584878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:03.624407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:03.649928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 555/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:03.926833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc3595-a8ca-48d5-90f9-88c9d500c8a1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:04.028332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc3595-a8ca-48d5-90f9-88c9d500c8a1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:04.061234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738108f-d38a-4fc6-9d90-f82187816c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:04.061846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738108f-d38a-4fc6-9d90-f82187816c92 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:04.062123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738108f-d38a-4fc6-9d90-f82187816c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:04.062941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738108f-d38a-4fc6-9d90-f82187816c92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:04.064135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738108f-d38a-4fc6-9d90-f82187816c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:04.065545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738108f-d38a-4fc6-9d90-f82187816c92 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:04.067222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 582/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:30:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:04.073266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:04.170815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83521761-ad17-4960-a682-6d95f0651e9c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:04.204589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60103a-c3d0-419d-93b2-1a0c86d894f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:04.205115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60103a-c3d0-419d-93b2-1a0c86d894f3 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:04.205396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60103a-c3d0-419d-93b2-1a0c86d894f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:04.205670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60103a-c3d0-419d-93b2-1a0c86d894f3 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:04.206309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60103a-c3d0-419d-93b2-1a0c86d894f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:04.207744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60103a-c3d0-419d-93b2-1a0c86d894f3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:04.308363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 556/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:30:04 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:30:06.573635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dace2da-a628-459b-944f-0d83c3ee3a11 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:06.574266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dace2da-a628-459b-944f-0d83c3ee3a11 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:06.574266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dace2da-a628-459b-944f-0d83c3ee3a11 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:06.575564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 583/1139] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:06.581924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091110-4786-443a-9979-96040691c592 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:06.582573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091110-4786-443a-9979-96040691c592 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:06.582573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091110-4786-443a-9979-96040691c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:06.605163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7b091110-4786-443a-9979-96040691c592 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:06.606383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7b091110-4786-443a-9979-96040691c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:06.633597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:06.687908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 557/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:06.961846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dace2da-a628-459b-944f-0d83c3ee3a11 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:06.974723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:07.065797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dace2da-a628-459b-944f-0d83c3ee3a11 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:07.099133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:07.099779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:07.100056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:07.100326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:07.110553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:30:07.115305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:07.116643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:30:07.117580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 584/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:07.122615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091110-4786-443a-9979-96040691c592 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:07.219183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091110-4786-443a-9979-96040691c592 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:07.252965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:07.253563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:07.253842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:07.254114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:07.254767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:07.255068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:07.256455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:07.264398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 558/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:07.270539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:07.339012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:07.369300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cfdde-b108-41d9-914a-878e18a5c148 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:07.402280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:07.402894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:07.403171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:07.403481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] PATH_INFO: `/v3/users/7d95749536b3412fbedb8fb8788a09fe` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:07.416829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] RBAC: Authorizing `identity:get_user(user_id=7d95749536b3412fbedb8fb8788a09fe)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:07.418245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:07.419863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 585/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:30:07 2022] GET /identity/v3/users/7d95749536b3412fbedb8fb8788a09fe => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:07.426389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:07.453858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:07.528686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71466354-0d2d-40f4-8113-6922ae069ccd None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:07.563080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:07.563538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:07.563820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:07.564090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:07.628869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:07.630301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:07.653704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:07.727308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 559/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:30:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:30:07.733308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:07.837146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0d3f-a513-4810-89d2-db8a3b9aeb27 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:07.864159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:07.871542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c97a-4457-48eb-865f-8c1c0cb99d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:07.872178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c97a-4457-48eb-865f-8c1c0cb99d97 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:07.872455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c97a-4457-48eb-865f-8c1c0cb99d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:07.872725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c97a-4457-48eb-865f-8c1c0cb99d97 None admin] PATH_INFO: `/v3/projects/56adac0fe84e4d1391d9cd20b611983b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:07.873822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c97a-4457-48eb-865f-8c1c0cb99d97 None admin] RBAC: Authorizing `identity:get_project(project_id=56adac0fe84e4d1391d9cd20b611983b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:07.875471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c97a-4457-48eb-865f-8c1c0cb99d97 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:07.877087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 586/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:30:07 2022] GET /identity/v3/projects/56adac0fe84e4d1391d9cd20b611983b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:07.883544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:07.983578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac618b-14b1-4d57-87cc-158a5f6e268a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:08.005130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:08.016918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:08.017521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:08.017802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:08.018075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:08.018792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=56adac0fe84e4d1391d9cd20b611983b, user.id=7d95749536b3412fbedb8fb8788a09fe) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:08.019102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:08.020541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8eac9-4362-481b-bcef-e41662c0e98c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:08.025724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 560/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:30:07 2022] GET /identity/v3/role_assignments?user.id=7d95749536b3412fbedb8fb8788a09fe&scope.project.id=56adac0fe84e4d1391d9cd20b611983b&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:10.170525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3cb8-8a23-43bc-b346-de36b7830173 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:10.171069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3cb8-8a23-43bc-b346-de36b7830173 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:10.171169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3cb8-8a23-43bc-b346-de36b7830173 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:10.173014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 587/1147] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:10.178182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:10.178577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:10.178674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:10.197158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:10.198333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:10.263900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 561/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:10.535889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3cb8-8a23-43bc-b346-de36b7830173 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:10.643081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3cb8-8a23-43bc-b346-de36b7830173 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:10.676389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:10.677008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:10.677283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:10.677554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:10.688298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:30:10.693120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:10.694114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:30:10.694977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 588/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:10.700338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:10.804225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb409d35-dd2d-4a38-808a-f78b82e1397c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:10.821796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:10.839930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:10.842617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:10.842617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:10.842617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:10.842617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:10.842617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:10.843906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:10.857012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 562/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:30:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:10.858287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:10.915708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:10.960807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0929-9208-479b-942e-069a26d2d01e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:10.994923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:10.995580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:10.995865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:10.996144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] PATH_INFO: `/v3/users/7d95749536b3412fbedb8fb8788a09fe` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:10.997261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] RBAC: Authorizing `identity:get_user(user_id=7d95749536b3412fbedb8fb8788a09fe)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:10.998691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:11.000356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 589/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:30:10 2022] GET /identity/v3/users/7d95749536b3412fbedb8fb8788a09fe => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:11.006187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:11.105882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3fb3-48b4-4546-b1e6-bbaef2b943e1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:11.139002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b071-7503-46d1-ab82-c973a6c655d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:11.139665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b071-7503-46d1-ab82-c973a6c655d5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:11.139947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b071-7503-46d1-ab82-c973a6c655d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:11.140476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b071-7503-46d1-ab82-c973a6c655d5 None admin] PATH_INFO: `/v3/projects/56adac0fe84e4d1391d9cd20b611983b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:11.141707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b071-7503-46d1-ab82-c973a6c655d5 None admin] RBAC: Authorizing `identity:get_project(project_id=56adac0fe84e4d1391d9cd20b611983b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:11.143125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b071-7503-46d1-ab82-c973a6c655d5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:11.144762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 563/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:30:11 2022] GET /identity/v3/projects/56adac0fe84e4d1391d9cd20b611983b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:11.150753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:11.253022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2192b5-2699-460a-9c7b-4e90b6b5ea4c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:11.276079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:11.286570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c065-03a6-4851-82d4-01fa67e57344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:11.288585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c065-03a6-4851-82d4-01fa67e57344 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:11.288585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c065-03a6-4851-82d4-01fa67e57344 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:11.288585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c065-03a6-4851-82d4-01fa67e57344 None admin] PATH_INFO: `/v3/projects/56adac0fe84e4d1391d9cd20b611983b/users/7d95749536b3412fbedb8fb8788a09fe/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:11.289706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c065-03a6-4851-82d4-01fa67e57344 None admin] RBAC: Authorizing `identity:create_grant(project_id=56adac0fe84e4d1391d9cd20b611983b, user_id=7d95749536b3412fbedb8fb8788a09fe, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:11.291227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c065-03a6-4851-82d4-01fa67e57344 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:11.395292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 590/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:30:11 2022] PUT /identity/v3/projects/56adac0fe84e4d1391d9cd20b611983b/users/7d95749536b3412fbedb8fb8788a09fe/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:30:13.555728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9188d5-15c5-4d19-8dff-b8ffccdc1cd4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:13.556241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9188d5-15c5-4d19-8dff-b8ffccdc1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:13.556358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9188d5-15c5-4d19-8dff-b8ffccdc1cd4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:13.557613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 564/1154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:13.563592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:13.564012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:13.564140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:13.582660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:13.584251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:13.649639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 591/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:13.931632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9188d5-15c5-4d19-8dff-b8ffccdc1cd4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:13.991239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:14.045047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9188d5-15c5-4d19-8dff-b8ffccdc1cd4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:14.079956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:14.080573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:14.080858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:14.081131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:14.091245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:30:14.096101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:14.097220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:30:14.098101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 565/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:14.103275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:14.203618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b19be-1d64-43dc-90eb-0f79106cf058 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:14.217432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:14.238438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:14.239035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:14.239316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:14.239625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:14.240282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:14.240587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:14.241997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:14.250943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 592/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:14.256647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:14.357544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ef5d-e3d9-4206-9d4c-06a1cfc2a29f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:14.365756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:14.397386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:14.398093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:14.398397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:14.398944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] PATH_INFO: `/v3/users/7d95749536b3412fbedb8fb8788a09fe` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:14.400553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] RBAC: Authorizing `identity:get_user(user_id=7d95749536b3412fbedb8fb8788a09fe)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:14.401983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:14.403598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 566/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:30:14 2022] GET /identity/v3/users/7d95749536b3412fbedb8fb8788a09fe => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:14.410223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:14.509330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8641c-bb7b-404f-847a-ceaea71cf835 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:14.542086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:14.542677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:14.542955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:14.543223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:14.586886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:14.609681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:14.613034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:14.709782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 593/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:30:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:30:14.715937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:14.818124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5daa7-e34e-470c-8d4e-20352cfd10bb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:14.851158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78285331-a950-4889-b904-564f0a44b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:14.851801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285331-a950-4889-b904-564f0a44b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:14.852083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285331-a950-4889-b904-564f0a44b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:14.852355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285331-a950-4889-b904-564f0a44b2f6 None admin] PATH_INFO: `/v3/projects/56adac0fe84e4d1391d9cd20b611983b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:14.853443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78285331-a950-4889-b904-564f0a44b2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=56adac0fe84e4d1391d9cd20b611983b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:14.854863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78285331-a950-4889-b904-564f0a44b2f6 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:14.856496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 567/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:30:14 2022] GET /identity/v3/projects/56adac0fe84e4d1391d9cd20b611983b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:30:14.863319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:14.940062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:14.963259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c31f-0ee7-4d1b-9c47-8420a071cdd6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:14.998331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:14.998927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:14.999234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:14.999554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:15.000287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=56adac0fe84e4d1391d9cd20b611983b, user.id=7d95749536b3412fbedb8fb8788a09fe) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:15.000592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:15.001994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39ee1-171b-4921-a5a6-548733e80a63 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:15.007611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 594/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:30:14 2022] GET /identity/v3/role_assignments?user.id=7d95749536b3412fbedb8fb8788a09fe&scope.project.id=56adac0fe84e4d1391d9cd20b611983b&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:17.190575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370ea2-2b06-4c43-9853-00f3ac5976e3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:17.191072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370ea2-2b06-4c43-9853-00f3ac5976e3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:17.191072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370ea2-2b06-4c43-9853-00f3ac5976e3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:17.192423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 568/1162] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:17.197607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:17.198035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:17.198138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:17.216819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:17.218672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:17.287430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 595/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:17.553964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e370ea2-2b06-4c43-9853-00f3ac5976e3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:17.598005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:17.655198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e370ea2-2b06-4c43-9853-00f3ac5976e3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:17.689372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:17.689975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:17.690257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:17.690531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:17.758768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:17.760230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:17.800368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:17.856858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 569/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:30:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:30:17.863414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:17.933638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:17.964798 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018856b-c505-4370-97b2-ad1e7ff5f589 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:18.003509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:18.004137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:18.004418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:18.004689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:18.011156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:18.012633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-562495de-8dfd-4096-8522-1e457c024633 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:18.024102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:18.025370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:30:18.026258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 596/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:30:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:18.031490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:18.136792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7408-e4af-4c79-b685-a55f42e594ea None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:18.184557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:18.185171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:18.185456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:18.185731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:18.186373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:18.187229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:18.188616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333574b2-1faf-4cce-b706-54601e06e403 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:18.195890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 570/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Sep 7 14:30:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:20.363912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e253-555c-4668-9ee1-430323efaa77 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:20.364443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e253-555c-4668-9ee1-430323efaa77 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:20.364443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e253-555c-4668-9ee1-430323efaa77 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:20.365807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 597/1167] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:20.371030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14562300-90fe-4333-95c0-913eaee1cdcc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:20.371495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14562300-90fe-4333-95c0-913eaee1cdcc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:20.371589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14562300-90fe-4333-95c0-913eaee1cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:20.385362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:20.391618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-14562300-90fe-4333-95c0-913eaee1cdcc None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:20.392820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-14562300-90fe-4333-95c0-913eaee1cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:20.459791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 571/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:20.728247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e253-555c-4668-9ee1-430323efaa77 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:20.828297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e253-555c-4668-9ee1-430323efaa77 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:20.856565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:20.863107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f9083-81d9-4ae4-bb3f-050c7293c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:20.865918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9083-81d9-4ae4-bb3f-050c7293c121 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:20.865918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9083-81d9-4ae4-bb3f-050c7293c121 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:20.865918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9083-81d9-4ae4-bb3f-050c7293c121 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:20.865918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9083-81d9-4ae4-bb3f-050c7293c121 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:20.866354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9083-81d9-4ae4-bb3f-050c7293c121 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:20.944575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 598/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Sep 7 14:30:20 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:30:23.130828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d01b7-41f2-4b54-b145-0045d8b1e750 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:23.131417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d01b7-41f2-4b54-b145-0045d8b1e750 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:23.131417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d01b7-41f2-4b54-b145-0045d8b1e750 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:23.132733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 572/1170] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:23.138044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:23.138473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:23.138601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:23.157774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:23.158954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:23.231776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 599/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:23.504154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d01b7-41f2-4b54-b145-0045d8b1e750 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:23.608730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d01b7-41f2-4b54-b145-0045d8b1e750 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:23.644161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f59d6-69bc-43ea-aae2-43d5f4fe617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:23.644800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f59d6-69bc-43ea-aae2-43d5f4fe617c None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:23.645086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f59d6-69bc-43ea-aae2-43d5f4fe617c None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:23.645360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f59d6-69bc-43ea-aae2-43d5f4fe617c None admin] PATH_INFO: `/v3/domains/cb3933b8efa94fa69099bdfdff85040e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:23.648259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:23.658821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f59d6-69bc-43ea-aae2-43d5f4fe617c None admin] RBAC: Authorizing `identity:get_domain(domain_id=cb3933b8efa94fa69099bdfdff85040e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:23.660400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f59d6-69bc-43ea-aae2-43d5f4fe617c None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:23.662056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 573/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Sep 7 14:30:23 2022] GET /identity/v3/domains/cb3933b8efa94fa69099bdfdff85040e => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:23.668133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:23.772268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfab22-bb90-4f46-8a66-e677ea5a1b94 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:23.792476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:23.806214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d07068-d6e8-40e0-b58b-192c2534f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:23.806823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07068-d6e8-40e0-b58b-192c2534f019 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:23.807129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07068-d6e8-40e0-b58b-192c2534f019 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:23.808897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07068-d6e8-40e0-b58b-192c2534f019 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:23.808897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07068-d6e8-40e0-b58b-192c2534f019 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:23.809575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07068-d6e8-40e0-b58b-192c2534f019 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:23.937443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 600/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:30:23 2022] POST /identity/v3/projects => generated 361 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:30:26.170879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9dbf0-48a9-4e66-8a4c-ae820e1bc83d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:26.171416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9dbf0-48a9-4e66-8a4c-ae820e1bc83d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:26.171511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9dbf0-48a9-4e66-8a4c-ae820e1bc83d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:26.172798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 574/1174] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:26.178299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142270-d657-4064-afd3-4a61c31132fd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:26.178683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142270-d657-4064-afd3-4a61c31132fd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:26.178825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70142270-d657-4064-afd3-4a61c31132fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:26.196950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-70142270-d657-4064-afd3-4a61c31132fd None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:26.198156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-70142270-d657-4064-afd3-4a61c31132fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:26.268267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 601/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:26.546909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9dbf0-48a9-4e66-8a4c-ae820e1bc83d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:26.654309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9dbf0-48a9-4e66-8a4c-ae820e1bc83d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:26.691072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22915-aea5-4f8d-91a1-ba312ba11094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:26.691822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22915-aea5-4f8d-91a1-ba312ba11094 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:26.692112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22915-aea5-4f8d-91a1-ba312ba11094 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:26.692383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22915-aea5-4f8d-91a1-ba312ba11094 None admin] PATH_INFO: `/v3/domains/cb3933b8efa94fa69099bdfdff85040e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:26.693487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f22915-aea5-4f8d-91a1-ba312ba11094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cb3933b8efa94fa69099bdfdff85040e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:26.694902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f22915-aea5-4f8d-91a1-ba312ba11094 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:26.696564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 575/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Sep 7 14:30:26 2022] GET /identity/v3/domains/cb3933b8efa94fa69099bdfdff85040e => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:30:26.711885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70142270-d657-4064-afd3-4a61c31132fd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:26.817581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70142270-d657-4064-afd3-4a61c31132fd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:26.819031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:26.855049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272016f2-e645-424d-97da-eaaab40af120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:26.855689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272016f2-e645-424d-97da-eaaab40af120 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:26.855967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272016f2-e645-424d-97da-eaaab40af120 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:26.856237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272016f2-e645-424d-97da-eaaab40af120 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:26.856903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272016f2-e645-424d-97da-eaaab40af120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:26.858999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272016f2-e645-424d-97da-eaaab40af120 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:26.997788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 602/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:30:26 2022] POST /identity/v3/users => generated 311 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:30:29.277413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0a49-86fa-4b22-ae6c-b43a862481be None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:29.277922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0a49-86fa-4b22-ae6c-b43a862481be None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:29.278016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0a49-86fa-4b22-ae6c-b43a862481be None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:29.279292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 576/1178] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:29.284880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:29.285324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:29.285417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:29.304591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:29.305797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:29.378289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 603/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:29.650653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea0a49-86fa-4b22-ae6c-b43a862481be None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:29.718999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:29.762933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea0a49-86fa-4b22-ae6c-b43a862481be None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:29.801698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:29.802346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:29.802633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:29.802913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:29.813802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:30:29.818613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:29.819768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:29.820822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:30:29.823679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 577/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:29.826027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:29.931665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:29.944155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9bd5-46a6-4adc-aa0b-dc7279378b17 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:29.979850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:29.980462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:29.980744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:29.981019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:29.981682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:29.981988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:29.983726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:29.993176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 604/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:30:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:29.999731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:30.118226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250bb7-4d3f-4114-b66e-32bd5f364100 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:30.143941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:30.156135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:30.159765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:30.159765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:30.159765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] PATH_INFO: `/v3/users/08d3a3cb5fd14ba8b43b8ff8519eabd5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:30.171842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=08d3a3cb5fd14ba8b43b8ff8519eabd5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:30.173317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:30.175794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 578/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:30:29 2022] GET /identity/v3/users/08d3a3cb5fd14ba8b43b8ff8519eabd5 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:30.181312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:30.302239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb05c91-1d83-4ec9-a808-2f970b62ff90 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:30.337616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:30.338229 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:30.338513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:30.338789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:30.359970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:30.409828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:30.411307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:30.512682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 605/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:30:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:30:30.519205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:30.626163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad09295-0e03-424b-8df2-24a37ec05fd9 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:30.663452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bd901-4c3b-43a3-a311-6a2008c20cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:30.664196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd901-4c3b-43a3-a311-6a2008c20cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:30.664481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd901-4c3b-43a3-a311-6a2008c20cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:30.664753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd901-4c3b-43a3-a311-6a2008c20cd7 None admin] PATH_INFO: `/v3/projects/b997e25a9d2c41b997c569b2ed7d8474` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:30.665878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bd901-4c3b-43a3-a311-6a2008c20cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=b997e25a9d2c41b997c569b2ed7d8474)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:30.667302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bd901-4c3b-43a3-a311-6a2008c20cd7 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:30.668934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 579/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:30:30 2022] GET /identity/v3/projects/b997e25a9d2c41b997c569b2ed7d8474 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:30.675691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:30.728827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:30.783183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6a24d-aa6f-45a2-9e77-5e69a8166fa1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:30.818901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:30.819565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:30.819886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:30.820153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:30.820872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=b997e25a9d2c41b997c569b2ed7d8474, user.id=08d3a3cb5fd14ba8b43b8ff8519eabd5) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:30.821179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:30.822595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a33cb-16c4-47ee-9fae-699a2cd83490 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:30.828150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 606/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:30:30 2022] GET /identity/v3/role_assignments?user.id=08d3a3cb5fd14ba8b43b8ff8519eabd5&scope.project.id=b997e25a9d2c41b997c569b2ed7d8474&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:33.032197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411492-dbc0-4505-b86a-6da0b17bd38f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:33.032197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411492-dbc0-4505-b86a-6da0b17bd38f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:33.032831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5411492-dbc0-4505-b86a-6da0b17bd38f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:33.033790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 580/1186] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:33.039130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:33.039560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:33.039753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:33.058298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:33.059525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:33.127958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 607/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:33.405768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5411492-dbc0-4505-b86a-6da0b17bd38f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:33.461244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:33.512319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5411492-dbc0-4505-b86a-6da0b17bd38f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:33.544850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:33.546239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:33.546613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:33.546891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:33.563880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:30:33.568754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:33.569752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:30:33.572304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 581/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:33.576160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:33.626732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:33.681974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d693ba-2a21-4061-bf93-577c6d19cda6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:33.718922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:33.719566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:33.719850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:33.720122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:33.720846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:33.721147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:33.722505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:33.730605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 608/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:33.737273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:33.841818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1413bf-a0c0-469d-89b4-90e240f8bfa8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:33.852701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:33.876527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:33.877154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:33.877434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:33.877709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] PATH_INFO: `/v3/users/08d3a3cb5fd14ba8b43b8ff8519eabd5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:33.878814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] RBAC: Authorizing `identity:get_user(user_id=08d3a3cb5fd14ba8b43b8ff8519eabd5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:33.880262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:33.881968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 582/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:30:33 2022] GET /identity/v3/users/08d3a3cb5fd14ba8b43b8ff8519eabd5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:33.887700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:33.995119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879059bc-d4fd-486e-92e9-a234775e6c50 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:34.002557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:34.028818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36e4b1-69ce-47ab-9410-3d57a8572c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:34.029978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36e4b1-69ce-47ab-9410-3d57a8572c51 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:34.030487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36e4b1-69ce-47ab-9410-3d57a8572c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:34.030757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36e4b1-69ce-47ab-9410-3d57a8572c51 None admin] PATH_INFO: `/v3/projects/b997e25a9d2c41b997c569b2ed7d8474` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:34.031879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36e4b1-69ce-47ab-9410-3d57a8572c51 None admin] RBAC: Authorizing `identity:get_project(project_id=b997e25a9d2c41b997c569b2ed7d8474)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:34.033300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36e4b1-69ce-47ab-9410-3d57a8572c51 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:34.035064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 609/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:30:33 2022] GET /identity/v3/projects/b997e25a9d2c41b997c569b2ed7d8474 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:34.041110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:34.144140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dccbf-e612-45c1-ba6b-1e669d0e1651 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:34.178837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0ca2-1485-4693-ac03-ad049406c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:34.179548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0ca2-1485-4693-ac03-ad049406c2b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:34.179822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0ca2-1485-4693-ac03-ad049406c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:34.180097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0ca2-1485-4693-ac03-ad049406c2b5 None admin] PATH_INFO: `/v3/projects/b997e25a9d2c41b997c569b2ed7d8474/users/08d3a3cb5fd14ba8b43b8ff8519eabd5/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:34.182033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0ca2-1485-4693-ac03-ad049406c2b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b997e25a9d2c41b997c569b2ed7d8474, user_id=08d3a3cb5fd14ba8b43b8ff8519eabd5, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:34.183534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe0ca2-1485-4693-ac03-ad049406c2b5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:34.278467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 583/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:30:34 2022] PUT /identity/v3/projects/b997e25a9d2c41b997c569b2ed7d8474/users/08d3a3cb5fd14ba8b43b8ff8519eabd5/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:30:36.477131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a696-9a2a-4ab0-807f-71afa6837e6f None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:36.477663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a696-9a2a-4ab0-807f-71afa6837e6f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:36.477663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2a696-9a2a-4ab0-807f-71afa6837e6f None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:36.479008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 610/1193] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:30:36.484876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:36.485293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:36.485432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:36.503922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:30:36.505109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:30:36.533931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:36.571695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 584/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:30:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:30:36.844128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2a696-9a2a-4ab0-807f-71afa6837e6f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:36.948910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2a696-9a2a-4ab0-807f-71afa6837e6f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:36.984801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:36.985436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:36.986015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:36.986015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:36.997254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:30:37.002570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:30:37.003723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:30:37.005179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 611/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:30:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:30:37.009824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:37.106895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f672d-d74a-4620-a2be-47e17459e99b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:37.141242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:37.141847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:37.142125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:37.142397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:37.143046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:37.143348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:37.144720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:37.152592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 585/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:37.158642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:37.194477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:37.260553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5065223-1adb-41b1-b8a0-c1aea880e810 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:37.293454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:37.294079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:37.294362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:37.294636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] PATH_INFO: `/v3/users/08d3a3cb5fd14ba8b43b8ff8519eabd5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:37.296449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] RBAC: Authorizing `identity:get_user(user_id=08d3a3cb5fd14ba8b43b8ff8519eabd5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:37.297878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:37.299465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 612/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Sep 7 14:30:37 2022] GET /identity/v3/users/08d3a3cb5fd14ba8b43b8ff8519eabd5 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:37.305340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:37.336500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:37.405548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472f8f6-2aba-41f7-a60c-46a0d944b69a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:37.439557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:37.440214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:37.440472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:37.440750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:37.507732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:37.509172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:37.538073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:37.606913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 586/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:30:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:30:37.613799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:37.711810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab4d18-664a-4ce6-b02e-c73fe21fb83e None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:37.713226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:37.744060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbdf35-c615-4bc6-8fd1-e397aab1634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:37.744685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbdf35-c615-4bc6-8fd1-e397aab1634e None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:37.745187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbdf35-c615-4bc6-8fd1-e397aab1634e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:37.745487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbdf35-c615-4bc6-8fd1-e397aab1634e None admin] PATH_INFO: `/v3/projects/b997e25a9d2c41b997c569b2ed7d8474` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:37.747054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbdf35-c615-4bc6-8fd1-e397aab1634e None admin] RBAC: Authorizing `identity:get_project(project_id=b997e25a9d2c41b997c569b2ed7d8474)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:37.749186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbdf35-c615-4bc6-8fd1-e397aab1634e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:37.750824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 613/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Sep 7 14:30:37 2022] GET /identity/v3/projects/b997e25a9d2c41b997c569b2ed7d8474 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:37.757104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:30:37.855881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3a584-0ddb-465e-ab74-eff534945102 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:30:37.883774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:37.889975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:30:37.896298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:30:37.896298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:30:37.896298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:30:37.896298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=b997e25a9d2c41b997c569b2ed7d8474, user.id=08d3a3cb5fd14ba8b43b8ff8519eabd5) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:30:37.896298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:30:37.896298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22655e-a47f-427a-ba36-e33701a886e2 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:30:37.899427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 587/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:30:37 2022] GET /identity/v3/role_assignments?user.id=08d3a3cb5fd14ba8b43b8ff8519eabd5&scope.project.id=b997e25a9d2c41b997c569b2ed7d8474&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:30:47.746369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=15 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:30:47.922475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:53.991355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a90ae-aff1-4ab3-a826-15228de2f249 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:53.991972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a90ae-aff1-4ab3-a826-15228de2f249 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:53.991972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a90ae-aff1-4ab3-a826-15228de2f249 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:53.993935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 614/1201] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:31:54.000231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:54.000720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:54.000844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:54.021435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:31:54.022754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:31:54.103170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 588/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:31:54.374367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a90ae-aff1-4ab3-a826-15228de2f249 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:54.481599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a90ae-aff1-4ab3-a826-15228de2f249 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:54.517839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:54.518671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:54.519081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:54.519319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:54.530205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:54.531688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:31:54.546162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:31:54.548357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:31:54.550005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:31:54.550005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:31:54.550005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:31:54.550005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 615/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:31:54.554420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:54.668975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e2caf-0a7f-4bd6-a928-eae69e760796 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:54.698568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:54.704037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:54.704643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:54.704930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:54.705207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:54.705994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:54.706142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:54.707793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e49e6-c622-437e-9ea3-eaaef8d36e37 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:54.719175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 589/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:31:54.726421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:54.787894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:54.839444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7abb2b-6afe-4718-8bec-f5bc5305ff4f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:54.875763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e97a8-197d-441e-8e59-8095564e87b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:54.876364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e97a8-197d-441e-8e59-8095564e87b8 None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:54.876645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e97a8-197d-441e-8e59-8095564e87b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:54.876917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e97a8-197d-441e-8e59-8095564e87b8 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:54.877595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e97a8-197d-441e-8e59-8095564e87b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:54.879067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e97a8-197d-441e-8e59-8095564e87b8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:54.984842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 616/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Sep 7 14:31:54 2022] POST /identity/v3/users => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:31:57.255832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9a5a8-f0d7-4441-b904-a6f2228f4f76 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:57.256439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9a5a8-f0d7-4441-b904-a6f2228f4f76 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:57.256439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9a5a8-f0d7-4441-b904-a6f2228f4f76 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:57.257738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 590/1206] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:31:57.263114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:57.264669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:57.264669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:57.282888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:31:57.290641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:31:57.353779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 617/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:31:57.628346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9a5a8-f0d7-4441-b904-a6f2228f4f76 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:57.739908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9a5a8-f0d7-4441-b904-a6f2228f4f76 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:57.777585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:57.778219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:57.778507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:57.778865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:57.789452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:31:57.794375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:31:57.795643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:31:57.796678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 591/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:31:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:31:57.801746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:57.845955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:57.911302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576951e-4fd0-4659-b2ec-0291824f1571 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:57.948646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:57.949310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:57.949597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:57.949869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:57.950533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:57.950835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:57.952416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:57.962287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 618/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:31:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:31:57.968266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:58.022123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:58.074359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e057e-e9db-461c-96c1-53d6e3ec2af4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:58.110325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:58.110960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:58.111244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:58.112118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:58.122942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:58.124407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:31:58.139610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:31:58.140851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:31:58.142075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:31:58.142075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:31:58.142075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:31:58.142075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 592/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:31:58.146712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:58.255235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:58.258154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a44b3e-9189-43a0-ac45-c39f3786313c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:58.295621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:58.296404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:58.296506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:58.296767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:58.297409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:58.297714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:58.299126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:58.311684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 619/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:31:58.317801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:58.426263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d985b7-b562-4341-a352-ef59d6eccee1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:58.427855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:58.463447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:58.464071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:58.464357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:58.464629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:58.471962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:58.473861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:31:58.486153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:31:58.491166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:31:58.492792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 593/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:31:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:31:58.493939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:58.599269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ffab3-8c3e-4ce2-993f-36bd8d9a7fcb None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:58.635650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:58.636250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:58.636554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:58.636827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:58.637553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:58.637860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:58.639294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:58.657373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 620/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Sep 7 14:31:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:31:58.663941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:58.776757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bdf3-2a2b-41f9-a45a-8e793fcae561 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:58.813813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:58.814650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:58.814935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:58.815215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:58.850876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:58.892132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:58.893478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:59.004896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 594/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:31:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:31:59.010911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:59.031167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:59.119286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3336557-da27-4275-bd84-4d16501216dc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:59.154302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:59.154982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:59.155400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:59.155700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:59.168453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:59.169980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:31:59.184851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:31:59.186655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:31:59.190331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:31:59.190331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:31:59.190331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:31:59.190331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 621/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:31:59.193247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:59.257928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:59.306805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50e392-4f6c-47f3-90e1-ce0eacae42c4 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:59.344933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:59.345638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:59.345816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:59.346092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:59.346737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:59.347046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:59.349093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:59.361174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 595/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:31:59.368663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:59.442162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:59.474480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980d61f-c704-47cd-b4e5-b93f6e5dfcb0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:59.512333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:59.512972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:59.513233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:59.513498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:59.520335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:59.522113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:31:59.533489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:31:59.534568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:31:59.535821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 622/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:31:59.540742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:59.646765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d7d6-b07f-4251-a58e-7b1529ac0e7a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:59.668781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:59.680893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:59.681510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:59.681798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:59.682107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:59.682804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:59.683118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:59.684738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894a770-ad62-4654-96c0-fa1d3bf37bb5 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:59.697357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 596/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:31:59.703512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:31:59.809668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b703bd-f86b-4822-8145-f1aba314a249 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:31:59.840307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:31:59.846262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:31:59.846869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:31:59.847151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:31:59.847455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:31:59.848209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=43b30d76472244e1a92d4787d0a2be66) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:31:59.848663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:31:59.850140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d88512-8619-4b02-bc55-e0355d6b3350 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:31:59.855700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 623/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:31:59 2022] GET /identity/v3/role_assignments?user.id=43b30d76472244e1a92d4787d0a2be66&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:02.121721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0879-3dd9-4619-a349-2ec40dd78983 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:02.122281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0879-3dd9-4619-a349-2ec40dd78983 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:02.122281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0879-3dd9-4619-a349-2ec40dd78983 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:02.123781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 597/1220] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:02.129697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:02.134787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:02.134787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:02.148863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:02.150102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:02.223178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 624/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:02.496471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff0879-3dd9-4619-a349-2ec40dd78983 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:02.611078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff0879-3dd9-4619-a349-2ec40dd78983 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:02.646495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:02.647125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:02.647432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:02.647710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:02.658025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:32:02.663696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:02.664889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:02.665971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 598/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:32:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:02.671250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:02.786086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd786db9-c929-40b2-9b93-9817c43a27b1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:02.814541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:02.828323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:02.828937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:02.829221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:02.829490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:02.830357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:02.830664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:02.833122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:02.842189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 625/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:32:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:02.848786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:02.895406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:02.956137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47d1d-0e83-47bf-81b7-ba424dc0b5c7 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:02.994135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:02.994779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:02.995065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:02.995346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:03.005836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:03.007280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:03.024240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:03.025494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:03.026807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:03.026807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:03.026807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:03.026807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 599/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:03.031525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:03.138996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05340697-c778-4dd0-9140-bfb2bafa28aa None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:03.176112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:03.177014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:03.177300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:03.177581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:03.178229 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:03.178540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:03.180042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:03.193267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 626/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:03.199221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:03.301085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:03.307936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917e635-aba2-4e67-bef4-a87c18649689 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:03.343474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:03.344099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:03.344378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:03.344645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:03.353515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:03.354977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:32:03.367289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:03.368554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:03.369871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:03.372072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 600/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:03.374296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:03.430333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:03.490888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e686f71-a580-4dc8-aaf4-f714fe62da1a None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:03.538950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:03.539603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:03.543751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:03.543751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:03.543751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:03.543751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:03.544294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:03.565761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 627/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Sep 7 14:32:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:03.571844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:03.681607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab24efc-8e6c-4aaf-997d-c6d5ad4477ba None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:03.718771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:03.719479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:03.719709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:03.720882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:03.731769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:03.733215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:03.748009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:03.749888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:03.751669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:03.751669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:03.751669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:03.751669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 601/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:03.757920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:03.864201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66757ca-b1f4-473f-9df0-7045b944d37c None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:03.866468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:03.897257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:03.897859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:03.898141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:03.898417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:03.899050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:03.899352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:03.900740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:03.913247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 628/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:03.919224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:03.929741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:04.026629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663aa2-59e9-4f42-9acf-362f46aa4435 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:04.061124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:04.061753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:04.062035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:04.062309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:04.069785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:04.071216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:32:04.083618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:04.084710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:04.085830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 602/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:32:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:32:04.090832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:04.192878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5239a9e-7a56-4b23-bc02-bf0259746444 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:04.227997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:04.228601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:04.228885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:04.229161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:04.229846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:04.230155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:04.231621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc062d96-c038-4653-a5f5-93b98cc93249 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:04.243633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 629/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:04.249700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:04.314626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:04.350373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165d2c9-8725-4b94-9c33-5d1554628fc1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:04.385634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a7520-e852-48c9-ac06-560fcc05f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:04.386266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a7520-e852-48c9-ac06-560fcc05f997 None admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:04.386589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a7520-e852-48c9-ac06-560fcc05f997 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:04.386836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a7520-e852-48c9-ac06-560fcc05f997 None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/43b30d76472244e1a92d4787d0a2be66/roles/0fe7661a404742f4b7abb906718e2744` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:04.401455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a7520-e852-48c9-ac06-560fcc05f997 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=43b30d76472244e1a92d4787d0a2be66, role_id=0fe7661a404742f4b7abb906718e2744)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:04.402880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a7520-e852-48c9-ac06-560fcc05f997 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:04.497095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 603/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:32:04 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/43b30d76472244e1a92d4787d0a2be66/roles/0fe7661a404742f4b7abb906718e2744 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:32:06.687735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f85b-8272-4fd0-897f-a83646779c28 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:06.688259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f85b-8272-4fd0-897f-a83646779c28 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:06.688352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737f85b-8272-4fd0-897f-a83646779c28 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:06.689626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 630/1233] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:06.695072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:06.695516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:06.697466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:06.714726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:06.715951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:06.791691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 604/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:07.059701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f85b-8272-4fd0-897f-a83646779c28 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:07.086672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:07.166083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737f85b-8272-4fd0-897f-a83646779c28 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:07.200695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:07.201326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:07.201609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:07.201884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:07.213112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:32:07.217925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:07.219027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:07.220080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 631/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Sep 7 14:32:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:07.225200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:07.272401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:07.324601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3cc7-1d16-4d41-8e3b-dd493f592d25 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:07.358863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:07.359488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:07.359767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:07.360037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:07.360691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:07.361002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:07.362338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:07.370785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 605/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Sep 7 14:32:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:07.376877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:07.462553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:07.478253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6ec80-fda8-434e-8729-e7b1aa193501 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:07.512767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:07.513396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:07.513678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:07.513953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:07.524326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:07.525786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:07.541827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:07.542844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:07.552082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:07.552082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:07.552082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:07.552082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 632/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:07.552607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:07.652100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804927b0-db67-4459-a0cd-807d794fdb0e None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:07.660991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:07.687032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:07.687673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:07.687960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:07.688234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:07.688872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:07.689179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:07.690524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:07.702625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 606/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:07.708723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:07.808227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94934-b1c9-4083-bb59-aa9665eb0b88 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:07.841325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:07.841947 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:07.842233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:07.842507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:07.845185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:07.850674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:07.852164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:32:07.864358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:07.866687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:07.867920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 633/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:07.871547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:07.970243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb98b3-ff31-43f4-8ba6-025e7038a11b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:08.005154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:08.005764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:08.006048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:08.006325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:08.007049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:08.007361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:08.008813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:08.025380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 607/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Sep 7 14:32:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:08.031464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:08.131198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc08f3-12c1-4e86-b29e-91ff2cc77262 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:08.164847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:08.165448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:08.165730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:08.166004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:08.231581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:08.239040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:08.240535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:08.339422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 634/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:32:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:32:08.345310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:08.373159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:08.446829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedfaa-8e77-4971-a293-5ed64372408a None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:08.481032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:08.481711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:08.481936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:08.482207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:08.492941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:08.494361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:08.509444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:08.510549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:08.511517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:08.511517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:08.511517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:08.511517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 608/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:08.516327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:08.615476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:08.622298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd561-de9c-4531-b578-0e424a4d6ca1 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:08.658428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:08.659028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:08.659307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:08.659606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:08.660343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:08.660648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:08.662043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:08.675589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 635/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:08.681369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:08.768833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:08.790092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23cd9-3767-42b2-a0b6-d4eec2c07185 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:08.824337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:08.824955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:08.825233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:08.825504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:08.832093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:08.833671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:32:08.844923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:08.849262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:08.850345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 609/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:08.853906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:08.979316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36e34-39bb-4c86-85fd-31b77323d3fd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:09.017458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:09.018081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:09.018358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:09.018635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:09.019552 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:09.019771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:09.021220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2648-192b-4e2f-9eaa-6d1b20928b54 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:09.033631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 636/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:09.041612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:09.158147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ef00-06d5-447f-a0ea-e96fea56ba38 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:09.196305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:09.196915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:09.197195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:09.197467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:09.198184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] RBAC: Adding query filter params (role.id=0fe7661a404742f4b7abb906718e2744, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=43b30d76472244e1a92d4787d0a2be66) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:09.198490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:09.199934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4bf8c-569a-4552-be1a-ca4d6fa32759 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:09.206094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 610/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:32:09 2022] GET /identity/v3/role_assignments?user.id=43b30d76472244e1a92d4787d0a2be66&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=0fe7661a404742f4b7abb906718e2744 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:11.535367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1c6a-3477-4bca-af9f-207f5dad77fc None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:11.535975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1c6a-3477-4bca-af9f-207f5dad77fc None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:11.536175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1c6a-3477-4bca-af9f-207f5dad77fc None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:11.537590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 637/1247] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:32:11.542710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:11.543152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:11.543258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:11.549740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:11.562204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:11.564975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:11.632261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 611/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:11.900834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a1c6a-3477-4bca-af9f-207f5dad77fc None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:11.919033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:12.006868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a1c6a-3477-4bca-af9f-207f5dad77fc None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:12.042777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:12.043432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:12.043724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:12.043998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:12.054537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:32:12.059362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:12.068400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:12.069387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 638/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:12.070183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:12.172231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956dd18-a949-49a5-bf6f-10dd8fa3acc1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:12.201306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:12.206223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:12.207744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:12.208030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:12.208308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:12.208978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:12.209339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:12.210698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:12.218727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 612/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:12.225518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:12.303988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:12.326780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fa20e-1ccd-4c03-bc5b-850a599fa7bc None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:12.361106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:12.361726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:12.362005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:12.362279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:12.372912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:12.374367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:12.388731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:12.394871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:12.396071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:12.396071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:12.396071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:12.396071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 639/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:12.396360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:12.497915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd909f-9e3b-453e-931d-1f865be35c63 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:12.530217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:12.530823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:12.531111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:12.531402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:12.532055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:12.532361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:12.533708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:12.547006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 613/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:32:12.553690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:12.655999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd87f4-30ec-4cc1-ae22-2944702ab4a0 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:12.682592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:12.690081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:12.690794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:12.691136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:12.691433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:12.699008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:12.700472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:32:12.712019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:12.717847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:12.719097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 640/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:12.719943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:12.776016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:12.824815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ace20-0e15-4bf6-9f46-6591716dc958 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:12.860080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:12.860675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:12.860952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:12.861227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:12.861944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:12.862248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:12.863711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:12.880311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 614/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Sep 7 14:32:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:12.886306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:12.990125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80837a-b817-449a-9a8c-1d431e775ebe None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:13.023000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:13.023628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:13.023914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:13.024191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:13.081950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:13.094324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:13.098544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:13.195099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 641/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:32:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:32:13.201144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:13.301518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e93a2-4a51-4ee5-a7f9-9447ff01219f None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:13.314672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:13.335846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:13.336407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:13.336687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:13.336961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:13.346578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:13.348597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:13.362528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:13.363711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:13.365077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:13.365077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:13.365077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:13.365077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 615/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:13.369665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:13.458405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:13.470499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836fe0-bbaf-4bcd-920a-0c72128729e5 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:13.504241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:13.504836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:13.505112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:13.505382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:13.506011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:13.506310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:13.507685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:13.518455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 642/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:13.524808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:13.625137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b9672-f8be-4438-9890-d8a03a786475 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:13.659722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:13.660350 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:13.660637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:13.660918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:13.667635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:13.669066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:32:13.680606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:13.681691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:13.682767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 616/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:13.687810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:13.792202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837269ec-a954-4aeb-aa45-f71b166810d6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:13.826685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:13.827287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:13.827600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:13.827879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:13.828566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:13.828879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:13.830312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5f9b3-3e64-4b4a-abaa-733d6d94e2ab None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:13.842382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 643/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:32:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:13.849368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:13.876126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:13.948565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef0c8-3516-4f04-832f-a5453d0e43d3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:13.983639 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:13.984261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:13.984527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:13.984805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:13.985605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=43b30d76472244e1a92d4787d0a2be66) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:13.985925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:13.987337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52ebb7-e9c9-4e24-9504-dfbc627bd944 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:13.993250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 617/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:32:13 2022] GET /identity/v3/role_assignments?user.id=43b30d76472244e1a92d4787d0a2be66&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:16.135226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984251b-3b60-4d31-a61f-63a065d29eb3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:16.135780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984251b-3b60-4d31-a61f-63a065d29eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:16.135894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984251b-3b60-4d31-a61f-63a065d29eb3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:16.137144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 644/1261] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:16.142443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:16.142858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:16.143036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:16.161718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:16.162934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:16.239601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 618/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:16.508173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984251b-3b60-4d31-a61f-63a065d29eb3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:16.519986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:16.616604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984251b-3b60-4d31-a61f-63a065d29eb3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:16.651334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:16.651986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:16.652266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:16.652539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:16.663289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:32:16.668185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:16.669484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:16.670561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 645/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:32:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:16.675666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:16.694749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:16.781468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca7d7-3406-4b37-bd7a-991cada2117b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:16.814739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:16.815347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:16.816191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:16.816474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:16.817315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:16.817648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:16.819037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:16.826948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 619/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:16.833171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:16.927335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:16.963722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598e66c-4b19-4439-bdc8-b732ff18a85d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:16.998010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:16.998635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:16.998918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:16.999197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.009421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.010876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:17.025484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:17.026736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:17.027790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:17.027790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:17.027790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:17.027790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 646/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 14:32:17.037501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:17.118931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:17.137655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d8a5-3aa9-4fae-a845-1c2f4b605331 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:17.171538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:17.172176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:17.172449 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:17.172720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.173538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:17.173847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.175253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:17.186782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 620/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:32:17.192492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:17.293507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57795876-212d-4312-baa6-4d20dc4cc19d None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:17.313303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:17.327106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:17.327771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:17.328057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:17.328332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.336620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.338051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:32:17.349793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:17.350973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:17.352027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 647/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:17.357010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:17.462948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e4cf9-6752-4fb5-950f-ba8f11d639d1 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:17.496292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:17.496896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:17.497179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:17.497453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.498172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:17.498480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.499971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:17.509958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:17.518087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 621/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Sep 7 14:32:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:17.524855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:17.624654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364ad8-cf09-4ec2-8836-1efc439b7dc8 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:17.657501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:17.658123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:17.658401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:17.658672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.669598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.671197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:17.685763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:17.686972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:17.688178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:17.688178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:17.688178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:17.688178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 648/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:17.694557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:17.794879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda854-9763-4026-b81d-7c1a8bf70ac3 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:17.828672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:17.829276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:17.829560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:17.829837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.830480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:17.830790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.832454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:17.843383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 622/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:17.849667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:17.882213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:17.952177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986c98-70df-4260-becb-31990f8e6f86 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:17.986870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:17.987587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:17.987962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:17.988319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:17.994824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:17.996301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:32:18.007643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:18.009176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:18.010418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 649/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:18.014734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:18.072760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:18.119000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48e08c-4249-4d41-a526-9dbbe329e0cb None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:18.152876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:18.153414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:18.153699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:18.153976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:18.154664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:18.155029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:18.156598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee733a4b-b77b-4282-acda-70878036be77 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:18.169186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 623/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:18.175362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:18.271846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:18.280312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45d391-cfcb-46d8-80d1-b581258d9e2f None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:18.313984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095f7c-7919-4444-9354-8e63d5822032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:18.314638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095f7c-7919-4444-9354-8e63d5822032 None admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:18.314924 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095f7c-7919-4444-9354-8e63d5822032 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:18.315191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095f7c-7919-4444-9354-8e63d5822032 None admin] PATH_INFO: `/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/43b30d76472244e1a92d4787d0a2be66/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:18.317882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe095f7c-7919-4444-9354-8e63d5822032 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user_id=43b30d76472244e1a92d4787d0a2be66, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:18.319321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe095f7c-7919-4444-9354-8e63d5822032 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:18.369384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 650/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Sep 7 14:32:18 2022] PUT /identity/v3/projects/e2b06ff986bb4ef685aa5ce1ec40f4a5/users/43b30d76472244e1a92d4787d0a2be66/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:32:20.532483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1514cb-ee3f-428a-b044-49cc72605a24 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:20.533028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1514cb-ee3f-428a-b044-49cc72605a24 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:20.533028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1514cb-ee3f-428a-b044-49cc72605a24 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:20.534433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 624/1274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:20.540533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:20.545897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:20.545897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:20.560958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:20.562461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:20.641985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 651/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:20.918093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1514cb-ee3f-428a-b044-49cc72605a24 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:21.027806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1514cb-ee3f-428a-b044-49cc72605a24 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:21.045191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:21.062386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:21.063010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:21.063291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:21.063589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:21.074027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 14:32:21.078964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:21.080038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:21.080902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 625/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Sep 7 14:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:21.086538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:21.169101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:21.188015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737f76a-35b0-41ef-9e53-6bb74d6c37ba None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:21.224906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:21.225506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:21.225791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:21.226066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:21.226724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:21.227035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:21.228440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:21.239156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 652/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Sep 7 14:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:21.245328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:21.352987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50ad9a-6047-43db-aa67-69df540165f8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:21.386746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:21.387398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:21.387682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:21.387967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:21.397985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:21.399454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:21.414358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:21.415568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:21.416683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:21.416683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:21.416683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:21.416683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 626/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:21.421519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:21.524190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081d001-5e10-4b64-9a9a-66fe8a02c0d3 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:21.557089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:21.557687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:21.557952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:21.558223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:21.558863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:21.559168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:21.560565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:21.573363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 653/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:21.580040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:21.621609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:21.688809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507a4b6-4678-448b-8dd9-abee7f48ca42 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:21.723742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:21.724372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:21.724658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:21.724938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:21.731885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:21.733304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 14:32:21.745417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:21.746654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 14:32:21.747802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:21.751299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 627/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:21.752503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:21.757099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:21.852096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582aae-1d22-4555-9525-7a951d113ebd None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:21.886524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:21.887110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:21.887409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:21.887685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:21.888396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:21.888701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:21.890117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:21.907085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 654/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Sep 7 14:32:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:21.913023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:22.008119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:22.017425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cb0bc-3723-4851-8d1b-718150696f4d None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:22.051720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:22.052313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:22.052591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:22.052861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:22.117511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:22.119010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:22.205542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:22.215965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 628/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Sep 7 14:32:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 14:32:22.222338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:22.283928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:22.321856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fec04f-d5de-4952-a02d-dc0ed076bb84 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:22.355996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:22.356618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:22.356893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:22.357162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:22.367537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:22.368977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 14:32:22.383257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:22.389908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 14:32:22.390831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 14:32:22.390831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 14:32:22.390831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:22.390831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 655/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:22.391071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:22.491915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3bc32-37c0-4d06-a451-40ab87930378 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:22.525700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:22.526302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:22.526585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:22.526861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:22.527532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:22.527844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:22.530333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:22.545208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 629/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Sep 7 14:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:22.547072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:22.650060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ded7-3099-4f3d-916e-82bf770272b6 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:22.664278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:22.685858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35676862-0887-405c-a236-5994ab919e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:22.686571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35676862-0887-405c-a236-5994ab919e18 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:22.686855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35676862-0887-405c-a236-5994ab919e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:22.687130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35676862-0887-405c-a236-5994ab919e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:22.696124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35676862-0887-405c-a236-5994ab919e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:22.697579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35676862-0887-405c-a236-5994ab919e18 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application [None req-35676862-0887-405c-a236-5994ab919e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 14:32:22.709238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:22.710350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: ERROR keystone.server.flask.application Sep 07 14:32:22.711438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 656/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Sep 7 14:32:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:22.716389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:22.767273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:22.817667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ceb07-34d8-4641-bfe5-5d8c60c5023b None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:22.851772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:22.852393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:22.852679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:22.852956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:22.853652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:22.853965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:22.855418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65c678-5bf0-4111-8f58-cc8d2c6f131b None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:22.868636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 630/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Sep 7 14:32:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:22.874833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35676862-0887-405c-a236-5994ab919e18 None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:22.984534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35676862-0887-405c-a236-5994ab919e18 None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:23.018868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:23.019734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:23.020006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:23.020275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:23.020981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] RBAC: Adding query filter params (role.id=7753c5d3c0704a95806502abd36b6b9a, scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5, user.id=43b30d76472244e1a92d4787d0a2be66) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:23.021327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:23.022858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c15f-0a05-4d5c-b57d-f6e7ca07a2bb None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:23.028545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 657/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Sep 7 14:32:22 2022] GET /identity/v3/role_assignments?user.id=43b30d76472244e1a92d4787d0a2be66&scope.project.id=e2b06ff986bb4ef685aa5ce1ec40f4a5&role.id=7753c5d3c0704a95806502abd36b6b9a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:25.204590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54f10-1c96-44da-a31a-cabf66abb3d8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:25.205116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54f10-1c96-44da-a31a-cabf66abb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:25.205116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54f10-1c96-44da-a31a-cabf66abb3d8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:25.207078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 631/1288] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:25.212399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:25.212834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:25.213050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:25.231452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:25.232642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:25.262268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:25.298718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 658/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:25.569656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54f10-1c96-44da-a31a-cabf66abb3d8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:25.670202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54f10-1c96-44da-a31a-cabf66abb3d8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:25.682117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:25.705409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:25.706327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:25.706619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:25.706893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] PATH_INFO: `/v3/services/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:25.707498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:25.708869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:25.718098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:25.719284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:25.720247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 632/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:32:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:25.725901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:25.825841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed3b9a-78bd-4b20-90cb-b434f45e7f89 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:25.860124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:25.860723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:25.861001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:25.861273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:25.861896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:25.862820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:25.864321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5df5a8-e68c-4301-b355-3fdb01781cc0 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:25.869237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 659/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Sep 7 14:32:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:25.875298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:25.976158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0d29-0b89-4852-a727-2550fa80a2db None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:26.013005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:26.013605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:26.013924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:26.014195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] PATH_INFO: `/v3/services` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:26.014817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:26.015118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:26.016498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796c67f-5b57-4619-9322-0a5e29cc0574 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:26.020918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 633/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Sep 7 14:32:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:28.226480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a49da-be95-4520-a690-201e89377e71 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:28.227048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a49da-be95-4520-a690-201e89377e71 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:28.227048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a49da-be95-4520-a690-201e89377e71 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:28.228300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 660/1293] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:28.233811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43d9a-0304-4b26-ab72-84bfd13611c9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:28.234311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43d9a-0304-4b26-ab72-84bfd13611c9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:28.234409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43d9a-0304-4b26-ab72-84bfd13611c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:28.253827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0ef43d9a-0304-4b26-ab72-84bfd13611c9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:28.255029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ef43d9a-0304-4b26-ab72-84bfd13611c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:28.286828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:28.325646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 634/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:28.604253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a49da-be95-4520-a690-201e89377e71 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:28.651277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:28.746128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a49da-be95-4520-a690-201e89377e71 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:28.781468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f3e3a-5cd4-46af-a741-2209fdaac48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:28.782072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f3e3a-5cd4-46af-a741-2209fdaac48e None admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:28.782351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f3e3a-5cd4-46af-a741-2209fdaac48e None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:28.782624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f3e3a-5cd4-46af-a741-2209fdaac48e None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:28.783276 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f3e3a-5cd4-46af-a741-2209fdaac48e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:28.785137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f3e3a-5cd4-46af-a741-2209fdaac48e None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:28.856025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 661/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Sep 7 14:32:28 2022] POST /identity/v3/services => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:32:31.063750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6f24-fc2c-4261-a726-2d7aaadc1a40 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:31.064317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6f24-fc2c-4261-a726-2d7aaadc1a40 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:31.064317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6f24-fc2c-4261-a726-2d7aaadc1a40 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:31.066280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 635/1296] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:31.072167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:31.072730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:31.072730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:31.099444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:31.100706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:31.184852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 662/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:31.466821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6f24-fc2c-4261-a726-2d7aaadc1a40 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:31.570509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6f24-fc2c-4261-a726-2d7aaadc1a40 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:31.613523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:31.614173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:31.614462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:31.614741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:31.615334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:31.616744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:31.626014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:31.632880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:31.633915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 636/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:32:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:31.634762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:31.653009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:31.734035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa47fc3-0ca4-46d7-bc03-4f1a03c1373f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:31.768538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:31.769296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:31.769584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:31.769856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:31.770486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] RBAC: Adding query filter params (name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:31.770794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:31.772186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:31.777815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 663/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Sep 7 14:32:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:31.785307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:31.819303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:31.889211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484005a9-6773-4ec9-b15b-ee9baf7d8024 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:31.924108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:31.925002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:31.925346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:31.925681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:31.926395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] RBAC: Adding query filter params (interface=public, service_id=bb5b8a832a3447c888277b3b1628be9e, region_id=RegionOne) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:31.926707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:31.928123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c635f-801c-44b9-ad07-0f446346536e None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:31.934127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 637/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Sep 7 14:32:31 2022] GET /identity/v3/endpoints?service_id=bb5b8a832a3447c888277b3b1628be9e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:31.941208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:32.042596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:32.060297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764fac9-21c8-4a7a-a587-5608ecdd2aac None admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:32.094671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a687aa-f855-4b19-b43b-cca4ab4d9ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:32.095346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a687aa-f855-4b19-b43b-cca4ab4d9ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:32.095572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a687aa-f855-4b19-b43b-cca4ab4d9ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:32.095849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a687aa-f855-4b19-b43b-cca4ab4d9ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:32.096642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a687aa-f855-4b19-b43b-cca4ab4d9ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:32.098006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a687aa-f855-4b19-b43b-cca4ab4d9ee2 None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:32.104714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 664/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Sep 7 14:32:31 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:32:34.333263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7d6d-1c04-48f1-adb0-c7d111f8ccca None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:34.333823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7d6d-1c04-48f1-adb0-c7d111f8ccca None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:34.333823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e7d6d-1c04-48f1-adb0-c7d111f8ccca None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:34.335147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 638/1302] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:32:34.340402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:34.340788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:34.340981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:34.359800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:32:34.361105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:32:34.428809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 665/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:32:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 14:32:34.697435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7d6d-1c04-48f1-adb0-c7d111f8ccca None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:34.795223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:34.801994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e7d6d-1c04-48f1-adb0-c7d111f8ccca None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:34.836374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:34.837011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:34.837296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:34.837567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:34.838146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:34.839563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 14:32:34.848871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 14:32:34.850239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application with Lock( Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self._enter() Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application return self.creator() Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application created_value = creator( Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: ERROR keystone.server.flask.application Sep 07 14:32:34.851168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 639/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Sep 7 14:32:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 14:32:34.856011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:34.934004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:34.958676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3c1f-bf92-4df7-97b9-145c949c7a4a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:34.998022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:34.998625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:34.998905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:34.999176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] PATH_INFO: `/v3/services` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:34.999839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:32:35.000144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:35.001857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d5da6-acb6-47d2-821d-55a80fd28b4d None admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:35.007610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 666/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Sep 7 14:32:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:32:35.013403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:32:35.125977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb18441-fb98-44a9-a92a-6ac0f3afdba8 None admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:32:35.160092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ac7f1-edca-4007-82a5-58f5d1348b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:32:35.160689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ac7f1-edca-4007-82a5-58f5d1348b58 None admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:32:35.160975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ac7f1-edca-4007-82a5-58f5d1348b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:32:35.161250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ac7f1-edca-4007-82a5-58f5d1348b58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:32:35.161907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ac7f1-edca-4007-82a5-58f5d1348b58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:32:35.163302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ac7f1-edca-4007-82a5-58f5d1348b58 None admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:32:35.244232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 640/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:32:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:32:45.004448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=30 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:32:45.239364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:37.883968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c9ef7-8947-4cb4-832e-ec7aa84fb188 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:37.885118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c9ef7-8947-4cb4-832e-ec7aa84fb188 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:37.885626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c9ef7-8947-4cb4-832e-ec7aa84fb188 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:37.905518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3574e-7825-4d7f-a645-6b91ed3cd328 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:37.905993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3574e-7825-4d7f-a645-6b91ed3cd328 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:37.906289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3574e-7825-4d7f-a645-6b91ed3cd328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:37.909888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 667/1307] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:37 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:38.061814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-74f3574e-7825-4d7f-a645-6b91ed3cd328 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:38.063086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-74f3574e-7825-4d7f-a645-6b91ed3cd328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:38.181848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 641/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:38.502035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4837d9-c8b0-4b37-adcd-932feaba449c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:38.502423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4837d9-c8b0-4b37-adcd-932feaba449c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:38.502594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4837d9-c8b0-4b37-adcd-932feaba449c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:38.503981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 668/1309] 10.222.0.17 () {54 vars in 965 bytes} [Wed Sep 7 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:38.511278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3d73-2d10-49ec-bac3-7727d51bfb88 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:38.511617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3d73-2d10-49ec-bac3-7727d51bfb88 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:38.511903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3d73-2d10-49ec-bac3-7727d51bfb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:38.606392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d9be3d73-2d10-49ec-bac3-7727d51bfb88 None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:38.608083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d9be3d73-2d10-49ec-bac3-7727d51bfb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:38.633383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:38.705767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 642/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Sep 7 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:38.715988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4837d9-c8b0-4b37-adcd-932feaba449c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:38:38.717919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd4837d9-c8b0-4b37-adcd-932feaba449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:38.852537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4837d9-c8b0-4b37-adcd-932feaba449c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:38:38.941778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:38:38.942427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:38.942870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:38.943150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:38.944789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:39.003711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:39.066332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:38:39.067870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f0ce1-e3f7-44bf-8444-e017e7956aa4 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:38:39.090902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 669/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:38:41.590616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aee817-88d8-4379-86a3-5cb70b093fa5 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:41.591166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aee817-88d8-4379-86a3-5cb70b093fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:41.591166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aee817-88d8-4379-86a3-5cb70b093fa5 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:41.592528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 643/1312] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:41.597982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233895e-ae1f-413f-b524-0837e3a16396 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:41.598423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233895e-ae1f-413f-b524-0837e3a16396 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:41.598522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233895e-ae1f-413f-b524-0837e3a16396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:41.674400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8233895e-ae1f-413f-b524-0837e3a16396 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:41.675576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8233895e-ae1f-413f-b524-0837e3a16396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:41.780710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 670/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:42.072587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aee817-88d8-4379-86a3-5cb70b093fa5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:38:42.074175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-94aee817-88d8-4379-86a3-5cb70b093fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:42.183301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aee817-88d8-4379-86a3-5cb70b093fa5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:38:42.259126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:42.262017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:38:42.262657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:42.262941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:42.263216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:42.265019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:42.391719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:38:42.393107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d8d71-f0ba-4a8e-96aa-dfe81aea2eb2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:38:42.414261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 644/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:38:45.140787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407a774-d1c7-407b-9bdb-3559a52828e0 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:45.141321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407a774-d1c7-407b-9bdb-3559a52828e0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:45.141321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407a774-d1c7-407b-9bdb-3559a52828e0 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:45.142698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 671/1315] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:45.150077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd33c14-4a9b-4b74-a839-c56df6e20b16 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:45.150568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd33c14-4a9b-4b74-a839-c56df6e20b16 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:45.150667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd33c14-4a9b-4b74-a839-c56df6e20b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:45.217488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cfd33c14-4a9b-4b74-a839-c56df6e20b16 None None] MFA Rules not processed for user `481499c89d4842f891010bc0ee49f392`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:45.218622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cfd33c14-4a9b-4b74-a839-c56df6e20b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:45.271230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:45.314891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 645/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:45.620641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b92fc-c03c-4e91-b671-f32094a9814a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:45.620929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b92fc-c03c-4e91-b671-f32094a9814a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:45.621236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b92fc-c03c-4e91-b671-f32094a9814a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:45.622579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 672/1317] 10.222.0.17 () {54 vars in 965 bytes} [Wed Sep 7 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:45.628337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e760419-95aa-4648-9a30-aa60858c3d2b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:45.628627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e760419-95aa-4648-9a30-aa60858c3d2b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:45.628907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e760419-95aa-4648-9a30-aa60858c3d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:45.706619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0e760419-95aa-4648-9a30-aa60858c3d2b None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:45.707857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0e760419-95aa-4648-9a30-aa60858c3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:45.788692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 646/1318] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Sep 7 14:38:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:45.801079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b92fc-c03c-4e91-b671-f32094a9814a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:38:45.809282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-730b92fc-c03c-4e91-b671-f32094a9814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:45.812701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:45.912045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b92fc-c03c-4e91-b671-f32094a9814a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:38:45.987521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:38:45.988127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:45.988405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:45.988676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:45.990312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:46.052275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:46.097980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:38:46.100186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c860f-43f6-4bab-9b57-0de0f9942ab4 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:38:46.122916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 673/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:38:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:38:49.493429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ca8f-e1a6-42e5-9d8d-0453bfc38b1a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:49.494015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ca8f-e1a6-42e5-9d8d-0453bfc38b1a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:49.494015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ca8f-e1a6-42e5-9d8d-0453bfc38b1a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:49.495314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 647/1320] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:49.500591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edf36-940d-4d65-ab7e-80dacc5df865 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:49.501043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edf36-940d-4d65-ab7e-80dacc5df865 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:49.501148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edf36-940d-4d65-ab7e-80dacc5df865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:49.567364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3f4edf36-940d-4d65-ab7e-80dacc5df865 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:49.568601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3f4edf36-940d-4d65-ab7e-80dacc5df865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:49.668755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 674/1321] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:38:49.970669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ca8f-e1a6-42e5-9d8d-0453bfc38b1a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:38:49.972268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b150ca8f-e1a6-42e5-9d8d-0453bfc38b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:50.025383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:50.078930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ca8f-e1a6-42e5-9d8d-0453bfc38b1a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:38:50.153792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:38:50.154404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:50.154686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:50.154963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:50.156592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:50.254069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:50.268009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:38:50.269438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc894d9-ea76-4537-8b2b-62e349416dd0 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:38:50.287889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 648/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:38:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:38:53.561215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9457f-bd8b-41d6-88e8-d1b86fc37e36 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:53.561741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9457f-bd8b-41d6-88e8-d1b86fc37e36 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:53.561741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9457f-bd8b-41d6-88e8-d1b86fc37e36 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:53.563455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 675/1323] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:53.568909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33f4c-38d0-42e2-854e-848802fdcdfb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:53.569371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33f4c-38d0-42e2-854e-848802fdcdfb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:53.569473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33f4c-38d0-42e2-854e-848802fdcdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:53.644773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-37e33f4c-38d0-42e2-854e-848802fdcdfb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:53.646257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-37e33f4c-38d0-42e2-854e-848802fdcdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:53.757131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 649/1324] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:54.048185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9457f-bd8b-41d6-88e8-d1b86fc37e36 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:38:54.049813 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-aba9457f-bd8b-41d6-88e8-d1b86fc37e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:54.071567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:54.159157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9457f-bd8b-41d6-88e8-d1b86fc37e36 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:38:54.237821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:38:54.238435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:54.238720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:54.239597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:54.241237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:54.314874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:54.354753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:38:54.356237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b938e6-0ef8-44de-bb23-1a145cc0a402 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:38:54.374370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 676/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:38:56.650294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ab575-4b48-447b-a709-560247077af4 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:56.650870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ab575-4b48-447b-a709-560247077af4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:56.650870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ab575-4b48-447b-a709-560247077af4 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:56.652252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 650/1326] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:56.658240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520e31-6061-47c2-9803-256b7438bad3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:56.658794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520e31-6061-47c2-9803-256b7438bad3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:56.658794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520e31-6061-47c2-9803-256b7438bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:56.727752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b5520e31-6061-47c2-9803-256b7438bad3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:56.728973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b5520e31-6061-47c2-9803-256b7438bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:56.829490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 677/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:38:57.121074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ab575-4b48-447b-a709-560247077af4 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:38:57.122743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aa1ab575-4b48-447b-a709-560247077af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:57.187831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:57.235444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ab575-4b48-447b-a709-560247077af4 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:38:57.312525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:38:57.313131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:57.313414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:57.313686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:57.315263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:57.428539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:57.431496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:38:57.432938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273004bd-cdef-4660-86b7-a0f455e58b7c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:38:57.452111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 651/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:38:59.722020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3145118-154f-406e-a00d-f0b5fded0323 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:59.722601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3145118-154f-406e-a00d-f0b5fded0323 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:59.722601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3145118-154f-406e-a00d-f0b5fded0323 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:59.724803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 678/1329] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:38:59.730380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbc67-a42c-4c40-bf1a-5f8be355ec57 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:38:59.730822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbc67-a42c-4c40-bf1a-5f8be355ec57 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:38:59.730924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cbc67-a42c-4c40-bf1a-5f8be355ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:38:59.798604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c09cbc67-a42c-4c40-bf1a-5f8be355ec57 None None] MFA Rules not processed for user `481499c89d4842f891010bc0ee49f392`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:38:59.799836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c09cbc67-a42c-4c40-bf1a-5f8be355ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:38:59.899076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 652/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:00.183426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3145118-154f-406e-a00d-f0b5fded0323 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:00.184983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f3145118-154f-406e-a00d-f0b5fded0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:00.219367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:00.300578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3145118-154f-406e-a00d-f0b5fded0323 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:00.380682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:00.381306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:00.381618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:00.381896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:00.383588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:00.465948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:00.499362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:00.501384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12287f2a-fa1f-4859-a38f-4ca2355beb75 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:00.519752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 679/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:03.202392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4104b-d2e9-4e93-89a9-fdf0699530b8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:03.202896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4104b-d2e9-4e93-89a9-fdf0699530b8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:03.202896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4104b-d2e9-4e93-89a9-fdf0699530b8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:03.204246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 653/1332] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:03.210201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c10c3f-a0cd-41e6-aed1-685c3ce518be None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:03.210631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c10c3f-a0cd-41e6-aed1-685c3ce518be None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:03.210751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c10c3f-a0cd-41e6-aed1-685c3ce518be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:03.277049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f8c10c3f-a0cd-41e6-aed1-685c3ce518be None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:03.278290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f8c10c3f-a0cd-41e6-aed1-685c3ce518be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:03.374648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 680/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:03.653867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4104b-d2e9-4e93-89a9-fdf0699530b8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:03.655444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ca4104b-d2e9-4e93-89a9-fdf0699530b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:03.732809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:03.767566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4104b-d2e9-4e93-89a9-fdf0699530b8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:03.842961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:03.843599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:03.843884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:03.844161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:03.845755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:03.956171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:03.957805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df248c91-82d4-4568-842c-929df198bd11 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:03.968232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:03.977486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 654/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:06.236887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f21fed-f2d2-4178-87b8-50880b372e33 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:06.237414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f21fed-f2d2-4178-87b8-50880b372e33 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:06.237414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f21fed-f2d2-4178-87b8-50880b372e33 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:06.239448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 681/1335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:06.244874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf318-f6b9-47ac-ac86-e7da840840fc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:06.245299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf318-f6b9-47ac-ac86-e7da840840fc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:06.245431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf318-f6b9-47ac-ac86-e7da840840fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:06.311355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e1edf318-f6b9-47ac-ac86-e7da840840fc None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:06.312598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1edf318-f6b9-47ac-ac86-e7da840840fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:06.410924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 655/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:06.699733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f21fed-f2d2-4178-87b8-50880b372e33 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:06.701262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f2f21fed-f2d2-4178-87b8-50880b372e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:06.746121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:06.813326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f21fed-f2d2-4178-87b8-50880b372e33 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:06.886439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:06.887043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:06.887327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:06.887646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:06.889210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:06.977571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:07.002650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:07.005285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746fc8c-90d0-449a-b75f-3905288860a5 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:07.024529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 682/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:09.891867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a777-bee7-4644-9814-6d52478f98d6 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:09.892410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a777-bee7-4644-9814-6d52478f98d6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:09.892410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a777-bee7-4644-9814-6d52478f98d6 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:09.893798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 656/1338] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:09.899428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f217-62ff-4a16-98a3-deb0bb99bb9a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:09.899845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f217-62ff-4a16-98a3-deb0bb99bb9a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:09.900017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f217-62ff-4a16-98a3-deb0bb99bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:09.974380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-68f7f217-62ff-4a16-98a3-deb0bb99bb9a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:09.975825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-68f7f217-62ff-4a16-98a3-deb0bb99bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:10.075683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 683/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:10.359141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a777-bee7-4644-9814-6d52478f98d6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:10.360727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8798a777-bee7-4644-9814-6d52478f98d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:10.438265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:10.467511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a777-bee7-4644-9814-6d52478f98d6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:10.542093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:10.542709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:10.542992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:10.543265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:10.544909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:10.654586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:10.656072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939d5de-bf59-4161-b9b1-6d988ebb5be0 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:10.675197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 657/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:15.235638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca830-7b56-4639-a55f-e12caf28f5de None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:15.236195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca830-7b56-4639-a55f-e12caf28f5de None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:15.236195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca830-7b56-4639-a55f-e12caf28f5de None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:15.237552 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 684/1341] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:15.243508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8140e-aaf5-437b-af95-a152f0237245 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:15.243949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8140e-aaf5-437b-af95-a152f0237245 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:15.244179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8140e-aaf5-437b-af95-a152f0237245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:15.250117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:15.312925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-36d8140e-aaf5-437b-af95-a152f0237245 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:15.314123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-36d8140e-aaf5-437b-af95-a152f0237245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:15.414389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 658/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:15.705862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaca830-7b56-4639-a55f-e12caf28f5de None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:15.708339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7aaca830-7b56-4639-a55f-e12caf28f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:15.762218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:15.830131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaca830-7b56-4639-a55f-e12caf28f5de None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:15.911342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:15.911978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:15.912262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:15.912535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:15.914160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:16.017565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:16.033844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:16.036139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa1eba-0873-473e-af54-54dd87820f4f service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:16.057138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 685/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:19.348289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41216b33-06f0-4a0b-978f-925505d00762 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:19.348945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41216b33-06f0-4a0b-978f-925505d00762 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:19.348945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41216b33-06f0-4a0b-978f-925505d00762 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:19.350373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 659/1344] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:19.356779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd94bfc-fa00-404d-83d1-59d4cc525220 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:19.357317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd94bfc-fa00-404d-83d1-59d4cc525220 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:19.357596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd94bfc-fa00-404d-83d1-59d4cc525220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:19.428713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-cbd94bfc-fa00-404d-83d1-59d4cc525220 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:19.429906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cbd94bfc-fa00-404d-83d1-59d4cc525220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:19.532995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 686/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:19.836800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41216b33-06f0-4a0b-978f-925505d00762 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:19.840461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-41216b33-06f0-4a0b-978f-925505d00762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:19.948704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:19.968714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41216b33-06f0-4a0b-978f-925505d00762 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:20.083654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:20.084546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:20.084829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:20.085111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:20.089747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:20.237266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:20.238411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1898c6-d311-4508-a162-fa1ed8fe2a27 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:20.261216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 660/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:24.872110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b8b3-38c7-4232-a257-ad7435151958 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:24.872642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b8b3-38c7-4232-a257-ad7435151958 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:24.872737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b8b3-38c7-4232-a257-ad7435151958 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:24.874047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 687/1347] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:24.880151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a0cc-12cb-4f3d-bf92-61df5536d03a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:24.880700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a0cc-12cb-4f3d-bf92-61df5536d03a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:24.880700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a0cc-12cb-4f3d-bf92-61df5536d03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:24.897362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:24.955543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b957a0cc-12cb-4f3d-bf92-61df5536d03a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:24.956941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b957a0cc-12cb-4f3d-bf92-61df5536d03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:25.067486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 661/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:25.348230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b8b3-38c7-4232-a257-ad7435151958 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:25.349799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-96e3b8b3-38c7-4232-a257-ad7435151958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:25.411274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:25.458563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b8b3-38c7-4232-a257-ad7435151958 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:25.540078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:25.540698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:25.540977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:25.541249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:25.542871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:25.657569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:25.662118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:25.663665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153049e-a2a8-4e7d-b355-216b7d04a1fc service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:25.682982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 688/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:30.840277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b54101-d8d3-4d6f-b0f5-696dab14a946 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:30.840819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b54101-d8d3-4d6f-b0f5-696dab14a946 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:30.840819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b54101-d8d3-4d6f-b0f5-696dab14a946 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:30.842403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 662/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:30.851477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f348d-14a1-4618-9325-d65e37f6c286 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:30.851477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f348d-14a1-4618-9325-d65e37f6c286 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:30.851477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f348d-14a1-4618-9325-d65e37f6c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:30.969438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-409f348d-14a1-4618-9325-d65e37f6c286 None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:30.971145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-409f348d-14a1-4618-9325-d65e37f6c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:31.133421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 689/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:35.062831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=59 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:35.993040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ca48-43c0-4b9f-a8ea-e82fec2d8df7 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:35.993526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ca48-43c0-4b9f-a8ea-e82fec2d8df7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:35.993975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ca48-43c0-4b9f-a8ea-e82fec2d8df7 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:35.996599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 663/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:39:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:36.004423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ae7e-73f9-4e26-813c-e27cc297c115 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:36.005127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ae7e-73f9-4e26-813c-e27cc297c115 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:36.005127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ae7e-73f9-4e26-813c-e27cc297c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:36.075219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:36.103331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5ff4ae7e-73f9-4e26-813c-e27cc297c115 None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:36.104807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5ff4ae7e-73f9-4e26-813c-e27cc297c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:36.235294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 690/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:37.205789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8aa4e-e083-4457-a52c-5b58a536f228 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:37.207030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8aa4e-e083-4457-a52c-5b58a536f228 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:37.207030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8aa4e-e083-4457-a52c-5b58a536f228 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:37.208236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 664/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:37.213737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3f371-dc65-4ee8-ba5d-e5969e1a9d69 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:37.214162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3f371-dc65-4ee8-ba5d-e5969e1a9d69 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:37.214269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3f371-dc65-4ee8-ba5d-e5969e1a9d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:37.295335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-99c3f371-dc65-4ee8-ba5d-e5969e1a9d69 None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:37.296971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-99c3f371-dc65-4ee8-ba5d-e5969e1a9d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:37.339946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:37.414140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 691/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:40.936401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab442-5d41-4349-8709-753acc1a0916 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:40.937279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab442-5d41-4349-8709-753acc1a0916 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:40.937564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab442-5d41-4349-8709-753acc1a0916 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:40.939893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 665/1356] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:40.944852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db454f-14c7-459a-90c0-2c0078219af8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:40.945738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db454f-14c7-459a-90c0-2c0078219af8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:40.946090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db454f-14c7-459a-90c0-2c0078219af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:41.043415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-12db454f-14c7-459a-90c0-2c0078219af8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:41.044900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-12db454f-14c7-459a-90c0-2c0078219af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:41.155538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 692/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:41.670014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1031-cb48-40ae-8727-ae4485b688d8 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:41.670931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1031-cb48-40ae-8727-ae4485b688d8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:41.671590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1031-cb48-40ae-8727-ae4485b688d8 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:41.673574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 666/1358] 10.222.0.17 () {54 vars in 962 bytes} [Wed Sep 7 14:39:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:41.689187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3b2d6-7ed9-47f6-aaa5-3a816bd32ac8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:41.689745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3b2d6-7ed9-47f6-aaa5-3a816bd32ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:41.690230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3b2d6-7ed9-47f6-aaa5-3a816bd32ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:41.715255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:41.784808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d6c3b2d6-7ed9-47f6-aaa5-3a816bd32ac8 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:41.786193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d6c3b2d6-7ed9-47f6-aaa5-3a816bd32ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:41.925572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 693/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Sep 7 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:39:41.936864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1031-cb48-40ae-8727-ae4485b688d8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:41.938815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c71f1031-cb48-40ae-8727-ae4485b688d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:42.102370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1031-cb48-40ae-8727-ae4485b688d8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:42.194000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:42.241696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:42.242319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:42.242605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:42.242881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:42.244558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:42.347394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:42.349183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a404e-346d-4fe2-9f4b-75aafc2a1dd8 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:42.369900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 667/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:44.812157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682ef2-76a0-46fb-83d3-b9ea96b18bf5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:44.812932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682ef2-76a0-46fb-83d3-b9ea96b18bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:44.812932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77682ef2-76a0-46fb-83d3-b9ea96b18bf5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:44.814156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 694/1361] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:44.820254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaf1f9-fdee-4478-a33f-ab350f87355d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:44.820685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaf1f9-fdee-4478-a33f-ab350f87355d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:44.820818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaf1f9-fdee-4478-a33f-ab350f87355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:44.897057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7efaf1f9-fdee-4478-a33f-ab350f87355d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:44.898191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7efaf1f9-fdee-4478-a33f-ab350f87355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:44.943455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:45.043409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 668/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:45.349015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77682ef2-76a0-46fb-83d3-b9ea96b18bf5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:45.350885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-77682ef2-76a0-46fb-83d3-b9ea96b18bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:45.423241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:45.514570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77682ef2-76a0-46fb-83d3-b9ea96b18bf5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:45.638885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:45.639534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:45.639815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:45.640084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:45.641912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:45.665701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:45.738182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:45.740268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cd945-6813-46dd-ba9a-50caa81b7d76 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:45.758680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 695/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:39:48.425695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148e86-ada0-4664-bf60-3be7547f221f None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:48.426278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148e86-ada0-4664-bf60-3be7547f221f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:48.426278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148e86-ada0-4664-bf60-3be7547f221f None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:48.427805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 669/1364] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:48.433127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18967-cd2b-4b4e-8506-6b76a67d8100 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:48.433560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18967-cd2b-4b4e-8506-6b76a67d8100 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:48.433679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18967-cd2b-4b4e-8506-6b76a67d8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:48.521321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-38a18967-cd2b-4b4e-8506-6b76a67d8100 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:48.523394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-38a18967-cd2b-4b4e-8506-6b76a67d8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:48.641175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:48.647411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 696/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:48.948610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86181a23-4b29-4419-b376-8e03d99d3000 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:48.948817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86181a23-4b29-4419-b376-8e03d99d3000 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:48.949247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86181a23-4b29-4419-b376-8e03d99d3000 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:48.950768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 670/1366] 10.222.0.17 () {54 vars in 962 bytes} [Wed Sep 7 14:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:48.957284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f10b-772e-471b-a076-d4d00b1723b5 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:48.962651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f10b-772e-471b-a076-d4d00b1723b5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:48.962651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f10b-772e-471b-a076-d4d00b1723b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:49.045824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7571f10b-772e-471b-a076-d4d00b1723b5 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:49.047188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7571f10b-772e-471b-a076-d4d00b1723b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:49.181090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 697/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Sep 7 14:39:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:49.195204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86181a23-4b29-4419-b376-8e03d99d3000 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:49.197121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-86181a23-4b29-4419-b376-8e03d99d3000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:49.369745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86181a23-4b29-4419-b376-8e03d99d3000 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:49.391772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:49.425538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee60-c557-4d84-a9b0-cd196075d3eb None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:49.425847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee60-c557-4d84-a9b0-cd196075d3eb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:49.426101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee60-c557-4d84-a9b0-cd196075d3eb None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:49.427613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 698/1368] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:39:49.433753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cda4-9a0e-4714-9078-c57e40565085 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:49.434358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cda4-9a0e-4714-9078-c57e40565085 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:49.434358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cda4-9a0e-4714-9078-c57e40565085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:49.523292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:49.532528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8454cda4-9a0e-4714-9078-c57e40565085 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:49.534375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8454cda4-9a0e-4714-9078-c57e40565085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:49.619337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:49.619992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:49.620274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:49.620586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:49.622285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:49.647457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 699/1369] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:49.719830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:49.721390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63099690-2198-4078-8b9c-e172b95ccc36 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:49.745744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 671/1370] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:50.006273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513462-408a-4a9d-9a7a-687245887e96 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:50.006273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513462-408a-4a9d-9a7a-687245887e96 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:50.006273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513462-408a-4a9d-9a7a-687245887e96 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:50.011472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 700/1371] 10.222.0.17 () {54 vars in 964 bytes} [Wed Sep 7 14:39:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:50.017221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98bc87-6aba-4b7b-9713-53ee20f70802 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:50.017606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98bc87-6aba-4b7b-9713-53ee20f70802 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:50.017817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98bc87-6aba-4b7b-9713-53ee20f70802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:50.059074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:50.138077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-da98bc87-6aba-4b7b-9713-53ee20f70802 None None] MFA Rules not processed for user `95f7c352378a4bc08f1d1acddae20cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:50.139812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-da98bc87-6aba-4b7b-9713-53ee20f70802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:50.231495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 672/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Sep 7 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:50.283008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513462-408a-4a9d-9a7a-687245887e96 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:50.283008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6d513462-408a-4a9d-9a7a-687245887e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:50.377074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513462-408a-4a9d-9a7a-687245887e96 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:50.406625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:50.461328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:50.462281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:50.462726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:50.463323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:50.465676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:50.598551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:50.600083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca0de2-dc15-437f-994c-a0c583a1939e service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:50.623776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 701/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:52.234898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb6d4e-f6b9-460a-b590-52ec58c32e1e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:52.235463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb6d4e-f6b9-460a-b590-52ec58c32e1e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:52.235463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb6d4e-f6b9-460a-b590-52ec58c32e1e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:52.237349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 673/1374] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:52.243133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727e91a-a31c-4c31-a3d9-b39672bf0f9b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:52.243666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727e91a-a31c-4c31-a3d9-b39672bf0f9b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:52.243777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727e91a-a31c-4c31-a3d9-b39672bf0f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:52.324011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2727e91a-a31c-4c31-a3d9-b39672bf0f9b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:52.325246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2727e91a-a31c-4c31-a3d9-b39672bf0f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:52.333837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:52.438756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 702/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:52.730254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb6d4e-f6b9-460a-b590-52ec58c32e1e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:52.733851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-99bb6d4e-f6b9-460a-b590-52ec58c32e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:52.862949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:52.905992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb6d4e-f6b9-460a-b590-52ec58c32e1e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:53.035772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:53.035772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:53.035772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:53.035772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:53.037289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:53.120180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:53.140714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:53.140714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d01ac-4ea6-4ee8-8fe9-947fbe6a7125 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:53.152829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 674/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:55.534071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7098c-c05b-48de-bc76-063fd833f694 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:55.534601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7098c-c05b-48de-bc76-063fd833f694 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:55.534601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7098c-c05b-48de-bc76-063fd833f694 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:55.538587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 703/1377] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:55.541274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd41c2-00f1-4523-8ae5-ddd5c03b7c99 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:55.541684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd41c2-00f1-4523-8ae5-ddd5c03b7c99 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:55.541855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd41c2-00f1-4523-8ae5-ddd5c03b7c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:55.625455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9ecd41c2-00f1-4523-8ae5-ddd5c03b7c99 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:55.626806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9ecd41c2-00f1-4523-8ae5-ddd5c03b7c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:55.739541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 675/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:56.048184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7098c-c05b-48de-bc76-063fd833f694 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:56.050723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e5f7098c-c05b-48de-bc76-063fd833f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:56.214034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:56.226162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7098c-c05b-48de-bc76-063fd833f694 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:56.360511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:56.361207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:56.362123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:56.362483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:56.364296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:56.468698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:56.470423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4d1fb-0261-474e-bef6-861992d42566 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:56.484668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:56.496322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 704/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:58.907221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44deb4-f6ba-4e4a-8b9f-922cb8a43f01 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:58.907805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44deb4-f6ba-4e4a-8b9f-922cb8a43f01 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:58.907805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44deb4-f6ba-4e4a-8b9f-922cb8a43f01 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:58.909475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 676/1380] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:39:58.916910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c525-7daa-4e92-8684-f259a6ab91ea None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:58.918320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c525-7daa-4e92-8684-f259a6ab91ea None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:58.918831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2c525-7daa-4e92-8684-f259a6ab91ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:59.003942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-63e2c525-7daa-4e92-8684-f259a6ab91ea None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:39:59.005195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-63e2c525-7daa-4e92-8684-f259a6ab91ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:59.119581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 705/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:39:59.422020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44deb4-f6ba-4e4a-8b9f-922cb8a43f01 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:39:59.424434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad44deb4-f6ba-4e4a-8b9f-922cb8a43f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:59.498094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:59.594707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44deb4-f6ba-4e4a-8b9f-922cb8a43f01 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:39:59.720423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:39:59.721042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:39:59.721477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:39:59.721837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:39:59.723220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:39:59.751585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:59.842265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:39:59.843860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5db96-f365-4fd4-a8e7-1156cb2f5fd1 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:39:59.864929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 677/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:02.428242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c366e0-f810-4d14-9c07-43a4bf37b85a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:02.428824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c366e0-f810-4d14-9c07-43a4bf37b85a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:02.428824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c366e0-f810-4d14-9c07-43a4bf37b85a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:02.430247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 706/1383] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:40:02.437120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05cdcc-219d-4ac4-87d5-dd06ea55c622 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:02.437699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05cdcc-219d-4ac4-87d5-dd06ea55c622 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:02.437699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05cdcc-219d-4ac4-87d5-dd06ea55c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:02.518324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2b05cdcc-219d-4ac4-87d5-dd06ea55c622 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:02.519564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2b05cdcc-219d-4ac4-87d5-dd06ea55c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:02.627327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:02.634618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 678/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:02.948507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c366e0-f810-4d14-9c07-43a4bf37b85a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:02.950286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-21c366e0-f810-4d14-9c07-43a4bf37b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:03.034544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:03.118094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c366e0-f810-4d14-9c07-43a4bf37b85a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:03.258180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:03.258795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:03.259095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:03.259364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:03.260991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:03.329717 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:03.396892 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:03.398932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecdd63-9fd6-416f-97c4-3e9d26a09434 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:03.422713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 707/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:05.798905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3379e-eb3e-414e-a402-a9d9251afbe2 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:05.800058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3379e-eb3e-414e-a402-a9d9251afbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:05.800358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3379e-eb3e-414e-a402-a9d9251afbe2 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:05.801921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 679/1386] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:05.807668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538b9f-d4dd-4581-b74b-ec7d8e56ccab None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:05.808098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538b9f-d4dd-4581-b74b-ec7d8e56ccab None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:05.808282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538b9f-d4dd-4581-b74b-ec7d8e56ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:05.877356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0e538b9f-d4dd-4581-b74b-ec7d8e56ccab None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:05.878638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0e538b9f-d4dd-4581-b74b-ec7d8e56ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:05.981927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 708/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:06.275976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3379e-eb3e-414e-a402-a9d9251afbe2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:06.277858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ad3379e-eb3e-414e-a402-a9d9251afbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:06.327678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645600e-95b5-4627-beb2-375950a96d8e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:06.327974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645600e-95b5-4627-beb2-375950a96d8e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:06.328249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645600e-95b5-4627-beb2-375950a96d8e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:06.329611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 709/1388] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:40:06.335921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83574-7772-4ab6-a6ec-614c3421b727 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:06.336202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83574-7772-4ab6-a6ec-614c3421b727 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:06.336512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83574-7772-4ab6-a6ec-614c3421b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:06.352855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:06.409647 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0ea83574-7772-4ab6-a6ec-614c3421b727 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:06.410875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ea83574-7772-4ab6-a6ec-614c3421b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:06.447513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3379e-eb3e-414e-a402-a9d9251afbe2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:06.520374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 710/1389] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:06.528081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:06.577717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:06.578327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:06.578605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:06.578874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:06.580578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:06.673805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:06.675411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bf8c3-b2f2-4b51-b2d9-9097f831a58d service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:06.693701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 680/1390] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:06.829258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e5911-3f62-48da-9df2-f0a6eae1951b None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:06.830339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e5911-3f62-48da-9df2-f0a6eae1951b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:06.830436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e5911-3f62-48da-9df2-f0a6eae1951b None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:06.832012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 711/1391] 10.222.0.17 () {54 vars in 961 bytes} [Wed Sep 7 14:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:06.837485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1d057-9482-4cbc-9d68-e711bd0a94ce None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:06.837955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1d057-9482-4cbc-9d68-e711bd0a94ce None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:06.838106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1d057-9482-4cbc-9d68-e711bd0a94ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:06.929911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bbe1d057-9482-4cbc-9d68-e711bd0a94ce None None] MFA Rules not processed for user `3c333a75ebd74779acf201947470a92e`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:06.931179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bbe1d057-9482-4cbc-9d68-e711bd0a94ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:06.957591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:07.021371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 681/1392] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Sep 7 14:40:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:07.029470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e5911-3f62-48da-9df2-f0a6eae1951b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:07.030904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d76e5911-3f62-48da-9df2-f0a6eae1951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:07.132318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:07.139324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e5911-3f62-48da-9df2-f0a6eae1951b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:07.219521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:07.220184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:07.220493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:07.220770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:07.222406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:07.336695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:07.338065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761ce8f-8476-4ac5-bbfc-0caf382ba1d7 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:07.358289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 712/1393] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:08.276328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dde8-249a-44d7-8ba1-d27fbdd0237d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:08.276328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dde8-249a-44d7-8ba1-d27fbdd0237d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:08.276823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264dde8-249a-44d7-8ba1-d27fbdd0237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:08.344498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5264dde8-249a-44d7-8ba1-d27fbdd0237d None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:08.345868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5264dde8-249a-44d7-8ba1-d27fbdd0237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:08.439912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 682/1394] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:08.487105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eaa69-14b1-4d2d-9268-12c3918251b6 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:08.487669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eaa69-14b1-4d2d-9268-12c3918251b6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:08.487764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eaa69-14b1-4d2d-9268-12c3918251b6 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:08.489073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 713/1395] 10.222.0.17 () {54 vars in 943 bytes} [Wed Sep 7 14:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:08.495419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351479-bc9f-46c2-8064-2f0291b3bc78 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:08.495711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351479-bc9f-46c2-8064-2f0291b3bc78 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:08.495985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351479-bc9f-46c2-8064-2f0291b3bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:08.558087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:08.589413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e1351479-bc9f-46c2-8064-2f0291b3bc78 None None] MFA Rules not processed for user `ac16c8f79f7748ffa341705c05f28e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:08.590610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e1351479-bc9f-46c2-8064-2f0291b3bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:08.699734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 683/1396] 10.222.0.17 () {58 vars in 1040 bytes} [Wed Sep 7 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:08.710348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eaa69-14b1-4d2d-9268-12c3918251b6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:08.711875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9b3eaa69-14b1-4d2d-9268-12c3918251b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:08.734893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:08.853726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eaa69-14b1-4d2d-9268-12c3918251b6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:08.970722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:08.971320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:08.971652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:08.971909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:08.973541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:08.980943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:09.023977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05cb5-998b-4f66-98a7-44201b7eb75d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:09.024422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05cb5-998b-4f66-98a7-44201b7eb75d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:09.024778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a05cb5-998b-4f66-98a7-44201b7eb75d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:09.026191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 684/1397] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:09.031156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a64c5-b94e-427c-b94f-cdf1723b6801 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:09.031472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a64c5-b94e-427c-b94f-cdf1723b6801 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:09.031754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a64c5-b94e-427c-b94f-cdf1723b6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:09.062203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:09.064526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:09.073212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 714/1398] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:40:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:40:09.101765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4d9a64c5-b94e-427c-b94f-cdf1723b6801 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:09.102979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4d9a64c5-b94e-427c-b94f-cdf1723b6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:09.152759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:09.201051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 685/1399] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:09.505498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:09.506922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:09.611361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a1db6-3af4-4d39-bad1-384f6a565637 service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:09.676074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:09.743853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:09.744470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:09.744755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:09.745035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:09.746648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:09.866442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:09.868142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763c900-294a-4e46-8ab6-2911df1ca37a service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:09.895564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 715/1400] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:12.782050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b7ac-1b4e-4ec2-b2b2-91937c4c7e40 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:12.783323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b7ac-1b4e-4ec2-b2b2-91937c4c7e40 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:12.783323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b7ac-1b4e-4ec2-b2b2-91937c4c7e40 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:12.785078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 686/1401] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:12.790737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61fd7-5774-401e-896f-d606008b4912 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:12.791232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61fd7-5774-401e-896f-d606008b4912 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:12.791339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61fd7-5774-401e-896f-d606008b4912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:12.868906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5cb61fd7-5774-401e-896f-d606008b4912 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:12.870218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5cb61fd7-5774-401e-896f-d606008b4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:12.886833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:12.994074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 716/1402] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:13.304481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b7ac-1b4e-4ec2-b2b2-91937c4c7e40 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:13.306010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c1e5b7ac-1b4e-4ec2-b2b2-91937c4c7e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:13.474765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b7ac-1b4e-4ec2-b2b2-91937c4c7e40 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:13.518345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:13.610140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:13.610884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:13.611163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:13.611477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:13.613101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:13.714957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:13.718019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb329040-1d41-488f-842e-1ad6ac33d9b8 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:13.740609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 687/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:16.123187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caedcdf-cc63-418d-bee7-a3617828c094 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:16.123909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caedcdf-cc63-418d-bee7-a3617828c094 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:16.123909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caedcdf-cc63-418d-bee7-a3617828c094 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:16.127179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 717/1404] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:16.131576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e023b-fd76-45ea-8117-4b23714bf9be None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:16.132085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e023b-fd76-45ea-8117-4b23714bf9be None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:16.132171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e023b-fd76-45ea-8117-4b23714bf9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:16.189299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:16.216718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e94e023b-fd76-45ea-8117-4b23714bf9be None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:16.217904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e94e023b-fd76-45ea-8117-4b23714bf9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:16.338843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 688/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:16.641297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caedcdf-cc63-418d-bee7-a3617828c094 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:16.642891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9caedcdf-cc63-418d-bee7-a3617828c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:16.815356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:16.822770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caedcdf-cc63-418d-bee7-a3617828c094 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:16.962155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:16.962768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:16.963052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:16.963330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:16.965062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:17.071584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:17.071584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee5411-755e-4655-92c0-bc73d5ee7827 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:17.090921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 718/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:19.557702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1056f-a94b-4190-adac-9edbdea9888e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:19.558280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1056f-a94b-4190-adac-9edbdea9888e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:19.558280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1056f-a94b-4190-adac-9edbdea9888e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:19.559763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 689/1407] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:19.565994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fda2-5332-4181-979c-c31372f1a1b9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:19.566515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fda2-5332-4181-979c-c31372f1a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:19.566619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fda2-5332-4181-979c-c31372f1a1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:19.571101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:19.659393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a191fda2-5332-4181-979c-c31372f1a1b9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:19.660743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a191fda2-5332-4181-979c-c31372f1a1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:19.785959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 719/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:20.082608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1056f-a94b-4190-adac-9edbdea9888e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:20.084569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-11d1056f-a94b-4190-adac-9edbdea9888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:20.218636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:20.269882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1056f-a94b-4190-adac-9edbdea9888e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:20.475581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:20.475581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:20.475581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:20.475581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:20.476069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:20.594034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:20.612741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:20.615155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33c14c-1c73-499d-8037-219b69dc3e77 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:20.657959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 690/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:29.784052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=64 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:30.646030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=11 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:33.802506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9e13a-67f4-48b5-bfd7-7c78f9d24302 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:33.803093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9e13a-67f4-48b5-bfd7-7c78f9d24302 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:33.803093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9e13a-67f4-48b5-bfd7-7c78f9d24302 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:33.804478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 720/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Sep 7 14:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:33.809652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903330-7b11-4df4-9315-9312fbb54443 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:33.810132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903330-7b11-4df4-9315-9312fbb54443 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:33.810257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903330-7b11-4df4-9315-9312fbb54443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:33.895501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-33903330-7b11-4df4-9315-9312fbb54443 None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:33.896729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-33903330-7b11-4df4-9315-9312fbb54443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:34.010498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 691/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Sep 7 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:34.026274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faae5e-c181-4896-9682-98fb8bdc4ba1 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:34.026561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faae5e-c181-4896-9682-98fb8bdc4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:34.026840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7faae5e-c181-4896-9682-98fb8bdc4ba1 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:34.028263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 721/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Sep 7 14:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:34.033711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058919a9-a26b-4c2b-a269-6fe0c6a417ca None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:34.034006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058919a9-a26b-4c2b-a269-6fe0c6a417ca None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:34.034311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058919a9-a26b-4c2b-a269-6fe0c6a417ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:34.111779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:34.114544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-058919a9-a26b-4c2b-a269-6fe0c6a417ca None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:34.115786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-058919a9-a26b-4c2b-a269-6fe0c6a417ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:34.250071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 692/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Sep 7 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:36.944443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8470-c9af-4fbf-a433-a1989d18e361 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:36.945279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8470-c9af-4fbf-a433-a1989d18e361 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:36.945279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8470-c9af-4fbf-a433-a1989d18e361 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:36.946297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:36.954732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7b349-c7dc-40b1-8cf5-2f455e074c7f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:36.955221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7b349-c7dc-40b1-8cf5-2f455e074c7f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:36.955351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7b349-c7dc-40b1-8cf5-2f455e074c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:37.022369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3ca7b349-c7dc-40b1-8cf5-2f455e074c7f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:37.023634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ca7b349-c7dc-40b1-8cf5-2f455e074c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:37.084915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:37.135784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:37.455957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8470-c9af-4fbf-a433-a1989d18e361 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:37.457487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b36e8470-c9af-4fbf-a433-a1989d18e361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:37.612089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8470-c9af-4fbf-a433-a1989d18e361 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:37.686186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:37.727689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:37.728215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:37.728498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:37.728771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:37.730357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:37.849576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:37.852657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebf34a-b035-41f7-b52d-24adfd3e62f4 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:37.885576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 723/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:39.082433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e2bbf-87bf-4d15-ae2a-e9cbfea09814 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:39.083243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e2bbf-87bf-4d15-ae2a-e9cbfea09814 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:39.083243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e2bbf-87bf-4d15-ae2a-e9cbfea09814 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:39.084748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:39.091349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7fda3-b789-4b78-9b33-4bd35f377ba8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:39.091861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7fda3-b789-4b78-9b33-4bd35f377ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:39.091985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7fda3-b789-4b78-9b33-4bd35f377ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:39.174957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-96a7fda3-b789-4b78-9b33-4bd35f377ba8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:39.176211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-96a7fda3-b789-4b78-9b33-4bd35f377ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:39.203003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:39.274893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:39.426446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e2bbf-87bf-4d15-ae2a-e9cbfea09814 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:39.427995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b75e2bbf-87bf-4d15-ae2a-e9cbfea09814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:39.584768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e2bbf-87bf-4d15-ae2a-e9cbfea09814 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:39.626959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:39.701902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:39.702518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:39.702805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:39.703094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:39.704892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:39.799295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:39.801010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a520b7-12cc-4382-92c8-2ab19e31dc99 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:39.829275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 695/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:40.997047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfdc59-0c4c-4e92-9239-1f94f5717849 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:40.997622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfdc59-0c4c-4e92-9239-1f94f5717849 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:40.997622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfdc59-0c4c-4e92-9239-1f94f5717849 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:40.998979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:41.006428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089b622-c781-481f-8b1e-803ce3daefa7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:41.006931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089b622-c781-481f-8b1e-803ce3daefa7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:41.007025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089b622-c781-481f-8b1e-803ce3daefa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:41.070634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:41.098872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d089b622-c781-481f-8b1e-803ce3daefa7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:41.100158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d089b622-c781-481f-8b1e-803ce3daefa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:41.201486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:41.354955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfdc59-0c4c-4e92-9239-1f94f5717849 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:41.356525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d1cfdc59-0c4c-4e92-9239-1f94f5717849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:41.515634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfdc59-0c4c-4e92-9239-1f94f5717849 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:41.529083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:41.637896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:41.638507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:41.638785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:41.639055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:41.640697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:41.731905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:41.738793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c99e05-1fa1-499c-8c8c-e6b8c85469ef service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:41.754674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 726/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:42.888088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddcfd-cd65-42d6-8cd6-9db6f1802e44 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:42.888607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddcfd-cd65-42d6-8cd6-9db6f1802e44 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:42.888607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddcfd-cd65-42d6-8cd6-9db6f1802e44 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:42.889965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:40:42.896650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596b75-96da-4144-a12c-e70d0670c995 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:42.902218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596b75-96da-4144-a12c-e70d0670c995 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:42.902218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596b75-96da-4144-a12c-e70d0670c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:42.918184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:42.981735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-79596b75-96da-4144-a12c-e70d0670c995 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:42.982988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-79596b75-96da-4144-a12c-e70d0670c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:43.083924 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:40:43.240127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ddcfd-cd65-42d6-8cd6-9db6f1802e44 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:43.241635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-498ddcfd-cd65-42d6-8cd6-9db6f1802e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:43.356346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:43.394654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ddcfd-cd65-42d6-8cd6-9db6f1802e44 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:43.540606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:43.541249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:43.541583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:43.541800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:43.543432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:43.620298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:43.633681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:43.635265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb488cf-6f6f-4d26-92b5-028134bdd012 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:43.653876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 698/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:44.780815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32d0b1-e068-4d55-a45a-1d35ea170b47 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:44.781478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32d0b1-e068-4d55-a45a-1d35ea170b47 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:44.781478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32d0b1-e068-4d55-a45a-1d35ea170b47 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:44.783244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:44.790384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16ec5f-f176-48a1-94f5-343c00bac129 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:44.790862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16ec5f-f176-48a1-94f5-343c00bac129 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:44.791138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16ec5f-f176-48a1-94f5-343c00bac129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:44.880161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8c16ec5f-f176-48a1-94f5-343c00bac129 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:44.881392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8c16ec5f-f176-48a1-94f5-343c00bac129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:44.991439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:45.144120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32d0b1-e068-4d55-a45a-1d35ea170b47 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:45.145537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ad32d0b1-e068-4d55-a45a-1d35ea170b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:45.230445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:45.293724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32d0b1-e068-4d55-a45a-1d35ea170b47 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:45.409620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:45.410144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:45.410425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:45.410699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:45.412368 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:45.462973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:45.505856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:45.507499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dd44e-7c76-4d5e-84a6-f7ea80e4d614 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:45.525619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 729/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:46.628804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151eee7-274a-47c1-862b-150a8502877e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:46.629379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151eee7-274a-47c1-862b-150a8502877e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:46.629379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151eee7-274a-47c1-862b-150a8502877e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:46.630739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:46.637162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1494de-aa34-4449-acdf-92fe5f191c78 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:46.637586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1494de-aa34-4449-acdf-92fe5f191c78 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:46.637705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1494de-aa34-4449-acdf-92fe5f191c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:46.716053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1f1494de-aa34-4449-acdf-92fe5f191c78 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:46.717272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1f1494de-aa34-4449-acdf-92fe5f191c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:46.823692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:46.981451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151eee7-274a-47c1-862b-150a8502877e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:46.982968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0151eee7-274a-47c1-862b-150a8502877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:47.032020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:47.132716 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151eee7-274a-47c1-862b-150a8502877e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:47.244974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:47.245565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:47.245853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:47.246131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:47.247779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:47.255100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:47.341316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:47.342907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a256ab-e726-4f82-906f-e532eb69ba1e service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:47.361220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 701/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:48.459856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcb77a-66c1-4511-8f83-42cc0620953e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:48.460425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcb77a-66c1-4511-8f83-42cc0620953e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:48.460425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcb77a-66c1-4511-8f83-42cc0620953e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:48.461764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:48.467949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b58ef-76ab-444d-b366-acfc279870fb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:48.468400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b58ef-76ab-444d-b366-acfc279870fb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:48.468497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b58ef-76ab-444d-b366-acfc279870fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:48.542654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-121b58ef-76ab-444d-b366-acfc279870fb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:48.543881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-121b58ef-76ab-444d-b366-acfc279870fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:48.617160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:48.646515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:48.799040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcb77a-66c1-4511-8f83-42cc0620953e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:48.800632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-47fcb77a-66c1-4511-8f83-42cc0620953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:48.818564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:48.955620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcb77a-66c1-4511-8f83-42cc0620953e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:49.042827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:49.069525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:49.070063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:49.070345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:49.070624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:49.072307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:49.163600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:49.165209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203fc85-507d-4ad6-bdb2-0ac1a9f7cb84 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:49.183916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 732/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:50.375950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2feaa-2175-4686-bfaf-4767fe6f4c9a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:50.376494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2feaa-2175-4686-bfaf-4767fe6f4c9a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:50.376494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2feaa-2175-4686-bfaf-4767fe6f4c9a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:50.377822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:50.384340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162205-ade4-4d12-b262-2a95ca201d88 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:50.384783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162205-ade4-4d12-b262-2a95ca201d88 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:50.384878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162205-ade4-4d12-b262-2a95ca201d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:50.461715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2d162205-ade4-4d12-b262-2a95ca201d88 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:50.462980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2d162205-ade4-4d12-b262-2a95ca201d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:50.509668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:50.565058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:50.715352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2feaa-2175-4686-bfaf-4767fe6f4c9a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:50.717821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-86f2feaa-2175-4686-bfaf-4767fe6f4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:50.879336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2feaa-2175-4686-bfaf-4767fe6f4c9a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:50.935659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:50.997462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:50.997995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:50.998278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:50.998554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:51.000303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:51.089228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:51.090820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96834a-0c5a-4735-b27f-5c3dccae62a0 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:51.108781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 704/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:52.210567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331305d-778a-4303-8392-3f28f0ada2d4 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:52.211224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331305d-778a-4303-8392-3f28f0ada2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:52.211224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331305d-778a-4303-8392-3f28f0ada2d4 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:52.212424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:52.218915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda003d-1527-4d65-b03d-3ccc3983125a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:52.219401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda003d-1527-4d65-b03d-3ccc3983125a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:52.219521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda003d-1527-4d65-b03d-3ccc3983125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:52.294411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7bda003d-1527-4d65-b03d-3ccc3983125a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:52.295641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7bda003d-1527-4d65-b03d-3ccc3983125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:52.298156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:52.395230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:52.546127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331305d-778a-4303-8392-3f28f0ada2d4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:52.548456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c331305d-778a-4303-8392-3f28f0ada2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:52.696579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331305d-778a-4303-8392-3f28f0ada2d4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:52.723895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:52.813025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:52.813550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:52.813834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:52.814133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:52.815945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:52.915311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:52.917279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5952b6-b5b1-4cbe-a97e-3a237b93ba80 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:52.936820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 735/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:55.027028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd501d5-1634-44c2-bc84-fa3e6f7e65d9 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:55.027603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd501d5-1634-44c2-bc84-fa3e6f7e65d9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:55.027603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd501d5-1634-44c2-bc84-fa3e6f7e65d9 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:55.028947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:55.034341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc022ec-aed9-47f8-afe3-c97da4ff5876 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:55.034894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc022ec-aed9-47f8-afe3-c97da4ff5876 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:55.034894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc022ec-aed9-47f8-afe3-c97da4ff5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:55.077370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:55.104496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2cc022ec-aed9-47f8-afe3-c97da4ff5876 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:55.105686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2cc022ec-aed9-47f8-afe3-c97da4ff5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:55.200609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:55.487715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd501d5-1634-44c2-bc84-fa3e6f7e65d9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:55.489236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7bd501d5-1634-44c2-bc84-fa3e6f7e65d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:55.592643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd501d5-1634-44c2-bc84-fa3e6f7e65d9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:55.625780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:55.666604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:55.667212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:55.667524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:55.667797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:55.669393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:55.778862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:55.780328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cfee0-180a-4479-8512-7a052f3aad63 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:55.800797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 707/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:40:58.124212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63672bc-f76c-442a-983f-ca1b153d1bab None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:58.125384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63672bc-f76c-442a-983f-ca1b153d1bab None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:58.125384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63672bc-f76c-442a-983f-ca1b153d1bab None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:58.126926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:40:58.132318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a62f6e-3b46-4811-ba45-21b29b96f96d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:58.132718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a62f6e-3b46-4811-ba45-21b29b96f96d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:58.132867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a62f6e-3b46-4811-ba45-21b29b96f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:58.199943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-53a62f6e-3b46-4811-ba45-21b29b96f96d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:40:58.201046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-53a62f6e-3b46-4811-ba45-21b29b96f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:58.214950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:58.299932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:40:58.588424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63672bc-f76c-442a-983f-ca1b153d1bab None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:40:58.589988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b63672bc-f76c-442a-983f-ca1b153d1bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:58.696262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63672bc-f76c-442a-983f-ca1b153d1bab None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:40:58.708369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:58.770175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:40:58.770833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:40:58.771154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:40:58.771446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:40:58.773118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:40:58.887180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:40:58.888569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa1103-58ab-4e8b-88cf-9c4cd15b1637 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:40:58.907663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 738/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:01.455437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552073-04f4-4813-82e8-094200c20146 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:01.456005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552073-04f4-4813-82e8-094200c20146 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:01.456005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552073-04f4-4813-82e8-094200c20146 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:01.457314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:01.462778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935706-d57e-4941-88ff-fa36380c7d52 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:01.463184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935706-d57e-4941-88ff-fa36380c7d52 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:01.463321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935706-d57e-4941-88ff-fa36380c7d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:01.511085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:01.529349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-92935706-d57e-4941-88ff-fa36380c7d52 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:01.531142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-92935706-d57e-4941-88ff-fa36380c7d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:01.634510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:01.924034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552073-04f4-4813-82e8-094200c20146 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:01.925691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e8552073-04f4-4813-82e8-094200c20146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:02.030369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552073-04f4-4813-82e8-094200c20146 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:02.071241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:02.104861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:02.105462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:02.105741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:02.106063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:02.108404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:02.218673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:02.220111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6844a34-e15f-4214-afb7-ed83d0739e56 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:02.238628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 710/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:04.552171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f943-63a9-46e8-baf5-2b05f34b67c6 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:04.552722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f943-63a9-46e8-baf5-2b05f34b67c6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:04.552722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f943-63a9-46e8-baf5-2b05f34b67c6 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:04.554075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:04.559484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861eee3-7f96-4941-ba06-6aeebdb72987 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:04.559907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861eee3-7f96-4941-ba06-6aeebdb72987 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:04.560026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861eee3-7f96-4941-ba06-6aeebdb72987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:04.626528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d861eee3-7f96-4941-ba06-6aeebdb72987 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:04.627754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d861eee3-7f96-4941-ba06-6aeebdb72987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:04.648818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:04.727610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:05.026169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f943-63a9-46e8-baf5-2b05f34b67c6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:05.027763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1970f943-63a9-46e8-baf5-2b05f34b67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:05.132749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970f943-63a9-46e8-baf5-2b05f34b67c6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:05.152979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:05.208629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:05.209149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:05.209430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:05.209703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:05.211304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:05.321195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:05.322635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fcc33-5af2-4188-9c99-7cb7b348ee5f service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:05.341057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 741/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:07.638471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da56ab-ccc6-4a33-8d1e-06e09d6123ec None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:07.639052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da56ab-ccc6-4a33-8d1e-06e09d6123ec None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:07.639052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da56ab-ccc6-4a33-8d1e-06e09d6123ec None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:07.640501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:07.645750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678c85-f995-4c65-9920-356231777d55 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:07.646177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678c85-f995-4c65-9920-356231777d55 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:07.646296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678c85-f995-4c65-9920-356231777d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:07.710884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:07.713447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-76678c85-f995-4c65-9920-356231777d55 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:07.714653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-76678c85-f995-4c65-9920-356231777d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:07.810713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:08.096323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da56ab-ccc6-4a33-8d1e-06e09d6123ec None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:08.097877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-51da56ab-ccc6-4a33-8d1e-06e09d6123ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:08.202473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da56ab-ccc6-4a33-8d1e-06e09d6123ec None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:08.254193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:08.278543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:08.279148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:08.279590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:08.279871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:08.281607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:08.392669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:08.394019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c4d60-c5a2-4fdc-bb44-7abdc13506aa service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:08.413839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 713/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:10.700468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe263571-5693-40b5-82a6-8d2368ad2418 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:10.701042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe263571-5693-40b5-82a6-8d2368ad2418 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:10.701042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe263571-5693-40b5-82a6-8d2368ad2418 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:10.703031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:10.708767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d07d-c771-4200-9de8-c355162e4835 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:10.709177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d07d-c771-4200-9de8-c355162e4835 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:10.709315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d07d-c771-4200-9de8-c355162e4835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:10.773799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f706d07d-c771-4200-9de8-c355162e4835 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:10.774998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f706d07d-c771-4200-9de8-c355162e4835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:10.803127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:10.871293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:11.161958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe263571-5693-40b5-82a6-8d2368ad2418 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:11.163577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fe263571-5693-40b5-82a6-8d2368ad2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:11.272490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe263571-5693-40b5-82a6-8d2368ad2418 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:11.302399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:11.349370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:11.349980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:11.350257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:11.350527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:11.352136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:11.460437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:11.461793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8662a2d-ce2c-411b-839b-edc0e9517677 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:11.480600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 744/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:13.714930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a2b9-b59f-4e36-9552-cdc7fd32cdcd None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:13.715487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a2b9-b59f-4e36-9552-cdc7fd32cdcd None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:13.715608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a2b9-b59f-4e36-9552-cdc7fd32cdcd None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:13.716864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:13.722864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7016a1-19a1-45d6-acd2-109d2f14583e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:13.723313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7016a1-19a1-45d6-acd2-109d2f14583e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:13.723461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7016a1-19a1-45d6-acd2-109d2f14583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:13.790839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ab7016a1-19a1-45d6-acd2-109d2f14583e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:13.792059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ab7016a1-19a1-45d6-acd2-109d2f14583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:13.801282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:13.891314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:14.176705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455a2b9-b59f-4e36-9552-cdc7fd32cdcd None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:14.178230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3455a2b9-b59f-4e36-9552-cdc7fd32cdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:14.282872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455a2b9-b59f-4e36-9552-cdc7fd32cdcd None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:14.338625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:14.356989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:14.357600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:14.357883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:14.369962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:14.369962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:14.469523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:14.470905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633c490-bb4d-4c0a-9c73-696b7bd4dc4c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:14.489597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 716/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:16.724135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0e25e-8137-45d7-817d-2ccf82f86b1c None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:16.730804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0e25e-8137-45d7-817d-2ccf82f86b1c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:16.730804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0e25e-8137-45d7-817d-2ccf82f86b1c None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:16.730804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:16.731635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f38cf1-f9a6-4b4e-8b7b-6f1e1d5f6a6b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:16.732057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f38cf1-f9a6-4b4e-8b7b-6f1e1d5f6a6b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:16.732201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f38cf1-f9a6-4b4e-8b7b-6f1e1d5f6a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:16.804516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-50f38cf1-f9a6-4b4e-8b7b-6f1e1d5f6a6b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:16.805742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-50f38cf1-f9a6-4b4e-8b7b-6f1e1d5f6a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:16.845508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:16.904207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:17.195632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0e25e-8137-45d7-817d-2ccf82f86b1c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:17.197155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fad0e25e-8137-45d7-817d-2ccf82f86b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:17.301370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0e25e-8137-45d7-817d-2ccf82f86b1c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:17.342193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:17.378373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:17.378971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:17.379250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:17.379556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:17.381215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:17.490329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:17.491712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ffd94-c774-48f2-9ffb-49a14aeb3a7c service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:17.509911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 747/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:19.704240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ceed-dabf-45da-b8d8-5cf25072e63a None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:19.704783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ceed-dabf-45da-b8d8-5cf25072e63a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:19.704884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ceed-dabf-45da-b8d8-5cf25072e63a None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:19.706200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:19.712001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcf85a-00f3-4e82-8d6b-e8f87791ffd1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:19.712420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcf85a-00f3-4e82-8d6b-e8f87791ffd1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:19.712565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcf85a-00f3-4e82-8d6b-e8f87791ffd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:19.781204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a3bcf85a-00f3-4e82-8d6b-e8f87791ffd1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:19.782339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a3bcf85a-00f3-4e82-8d6b-e8f87791ffd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:19.801332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:19.883736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:20.171688 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1ceed-dabf-45da-b8d8-5cf25072e63a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:20.173234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69c1ceed-dabf-45da-b8d8-5cf25072e63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:20.277680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1ceed-dabf-45da-b8d8-5cf25072e63a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:20.344691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:20.351679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:20.352287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:20.352567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:20.352840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:20.354453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:20.463044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:20.464392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6d9df-dda4-487b-aa63-e4b558244988 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:20.483412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 719/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:22.918594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db383a11-732b-4468-b344-1617af90769a None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:22.918594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db383a11-732b-4468-b344-1617af90769a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:22.918594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db383a11-732b-4468-b344-1617af90769a None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:22.919405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:41:22.925879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e9e0-e5c0-463c-bcf5-a9edf7c4b4e2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:22.926389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e9e0-e5c0-463c-bcf5-a9edf7c4b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:22.926511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e9e0-e5c0-463c-bcf5-a9edf7c4b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:22.995839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7f74e9e0-e5c0-463c-bcf5-a9edf7c4b4e2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:22.997100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7f74e9e0-e5c0-463c-bcf5-a9edf7c4b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:23.048106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:23.097387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:23.383050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db383a11-732b-4468-b344-1617af90769a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:23.384629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-db383a11-732b-4468-b344-1617af90769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:23.488544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db383a11-732b-4468-b344-1617af90769a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:23.536355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:23.563190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:23.563831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:23.564116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:23.564393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:23.565993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:23.676872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:23.678336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eae276-2258-4b25-ab93-f31dad861799 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:23.695965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 750/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:33.095552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=22 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:33.693684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=66 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:43.787928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4cbe-49d2-4299-bc51-16a864b419e6 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:43.788457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4cbe-49d2-4299-bc51-16a864b419e6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:43.788457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4cbe-49d2-4299-bc51-16a864b419e6 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:43.789739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 721/1471] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:43.796030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7129-1b15-4605-b219-a49c4d66bc8a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:43.796481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7129-1b15-4605-b219-a49c4d66bc8a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:43.796580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7129-1b15-4605-b219-a49c4d66bc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:43.864851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5bfd7129-1b15-4605-b219-a49c4d66bc8a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:43.866072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5bfd7129-1b15-4605-b219-a49c4d66bc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:43.963800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 751/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:44.261139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb995699-ad0d-419c-ab90-86366a727b84 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:44.261426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb995699-ad0d-419c-ab90-86366a727b84 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:44.261698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb995699-ad0d-419c-ab90-86366a727b84 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:44.263051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 722/1473] 10.222.0.17 () {54 vars in 961 bytes} [Wed Sep 7 14:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:44.268086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3ccd9-d575-4bf5-8d1c-93f7403fb4b1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:44.268373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3ccd9-d575-4bf5-8d1c-93f7403fb4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:44.268644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3ccd9-d575-4bf5-8d1c-93f7403fb4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:44.345283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-31c3ccd9-d575-4bf5-8d1c-93f7403fb4b1 None None] MFA Rules not processed for user `3c333a75ebd74779acf201947470a92e`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:44.346489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-31c3ccd9-d575-4bf5-8d1c-93f7403fb4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:44.366748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:44.423014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 752/1474] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Sep 7 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:44.430784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb995699-ad0d-419c-ab90-86366a727b84 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:44.432285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bb995699-ad0d-419c-ab90-86366a727b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:44.536356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb995699-ad0d-419c-ab90-86366a727b84 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:44.608885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:44.609492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:44.609773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:44.610046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:44.611672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:44.665985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:44.728661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:44.730090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6b27-ee75-4da7-a14b-2a0fdf1e50b7 service glance] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:44.750184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 723/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:46.992031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec59f-c738-4a61-8b9e-a861a434f36e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:46.992582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec59f-c738-4a61-8b9e-a861a434f36e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:46.992582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ec59f-c738-4a61-8b9e-a861a434f36e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:46.993974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 753/1476] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:46.999298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524fb4f-122a-4193-a7f4-be2c63df905c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:46.999750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524fb4f-122a-4193-a7f4-be2c63df905c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:46.999901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524fb4f-122a-4193-a7f4-be2c63df905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:47.066012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7524fb4f-122a-4193-a7f4-be2c63df905c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:47.067227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7524fb4f-122a-4193-a7f4-be2c63df905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:47.165269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 724/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:47.443569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ec59f-c738-4a61-8b9e-a861a434f36e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:47.445184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-770ec59f-c738-4a61-8b9e-a861a434f36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:47.575642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ec59f-c738-4a61-8b9e-a861a434f36e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:47.744500 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:47.789917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:47.790523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:47.790807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:47.791084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:47.791762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:47.793472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:41:47.793472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:41:47.793472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:41:47.795301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f262e9c-ca89-4053-b39f-5d3d9456c4ac admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:47.814075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 754/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Sep 7 14:41:47 2022] GET /identity/v3/projects => generated 2553 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:41:50.022818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed13ac-aae5-4229-9f19-3184d2a07e3b None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:50.023400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed13ac-aae5-4229-9f19-3184d2a07e3b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:50.023503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed13ac-aae5-4229-9f19-3184d2a07e3b None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:50.024848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 725/1479] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:50.030221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0769d-bfca-4883-b226-89949b9ebf5b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:50.030628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0769d-bfca-4883-b226-89949b9ebf5b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:50.030773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0769d-bfca-4883-b226-89949b9ebf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:50.097281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-06b0769d-bfca-4883-b226-89949b9ebf5b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:50.098431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-06b0769d-bfca-4883-b226-89949b9ebf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:50.194193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 755/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:50.491254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed13ac-aae5-4229-9f19-3184d2a07e3b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:50.492816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9fed13ac-aae5-4229-9f19-3184d2a07e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:50.502553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:50.640645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed13ac-aae5-4229-9f19-3184d2a07e3b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:50.722142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:50.755178 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:50.755814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:50.756100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:50.756369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:50.757954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:50.848173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:50.849797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e6480-a3b8-457b-9ea2-115c2348bdab service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:50.868019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 726/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:53.291242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765513-31ba-440f-b271-a6c219319591 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:53.291808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765513-31ba-440f-b271-a6c219319591 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:53.291808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765513-31ba-440f-b271-a6c219319591 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:53.293181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 756/1482] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:53.298719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171031ff-a285-484c-b9a5-8530849ffbb8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:53.299146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171031ff-a285-484c-b9a5-8530849ffbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:53.299344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171031ff-a285-484c-b9a5-8530849ffbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:53.375059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-171031ff-a285-484c-b9a5-8530849ffbb8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:53.376293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-171031ff-a285-484c-b9a5-8530849ffbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:53.422465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:53.476661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 727/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:53.768941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84765513-31ba-440f-b271-a6c219319591 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:53.774212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-84765513-31ba-440f-b271-a6c219319591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:53.797594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:53.878510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84765513-31ba-440f-b271-a6c219319591 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:53.953425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:53.954041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:53.954329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:53.954601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:53.956257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:54.030402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:54.064862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:54.066294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bce37-813b-45d8-9def-dd8cb41ab765 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:54.084776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 757/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:56.309991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35766-43b4-4eab-b922-4a60e2a615f6 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:56.310797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35766-43b4-4eab-b922-4a60e2a615f6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:56.310797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35766-43b4-4eab-b922-4a60e2a615f6 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:56.312310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 728/1485] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:56.317645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51f83-15bd-4c24-978e-252092f5409f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:56.318100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51f83-15bd-4c24-978e-252092f5409f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:56.318231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51f83-15bd-4c24-978e-252092f5409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:56.385935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4db51f83-15bd-4c24-978e-252092f5409f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:56.387190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4db51f83-15bd-4c24-978e-252092f5409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:56.485680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 758/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:41:56.778916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35766-43b4-4eab-b922-4a60e2a615f6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:56.780658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d6a35766-43b4-4eab-b922-4a60e2a615f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:56.889665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35766-43b4-4eab-b922-4a60e2a615f6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:41:56.967293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:56.969020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:41:56.969630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:56.969915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:56.970190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:56.971820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:57.082839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:41:57.084313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ac015-7584-4be5-839f-f85a533b61f9 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:41:57.103181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 729/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:41:59.367486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ea4c-20d3-48ec-b90b-7d8849acdaf3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:59.368058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ea4c-20d3-48ec-b90b-7d8849acdaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:59.368376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ea4c-20d3-48ec-b90b-7d8849acdaf3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:59.369843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 759/1488] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:41:59.376246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5fe37-ba50-4635-8a10-81248e686175 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:41:59.376727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5fe37-ba50-4635-8a10-81248e686175 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:41:59.376841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5fe37-ba50-4635-8a10-81248e686175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:41:59.452908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e8c5fe37-ba50-4635-8a10-81248e686175 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:41:59.454136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e8c5fe37-ba50-4635-8a10-81248e686175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:59.506222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:59.551477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 730/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:41:59.845895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07ea4c-20d3-48ec-b90b-7d8849acdaf3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:41:59.847526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7d07ea4c-20d3-48ec-b90b-7d8849acdaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:41:59.885725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:41:59.959518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07ea4c-20d3-48ec-b90b-7d8849acdaf3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:42:00.033172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:42:00.033780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:42:00.034061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:42:00.034335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:42:00.035961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:42:00.120686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:42:00.149308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:42:00.150749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b04e4c-e319-4f9c-b9c9-39e3663ad65a service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:42:00.170610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 760/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:42:02.774114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6059-7dd3-4a7f-bde5-7c61557bc3a9 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:42:02.774678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6059-7dd3-4a7f-bde5-7c61557bc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:42:02.774678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6059-7dd3-4a7f-bde5-7c61557bc3a9 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:42:02.776031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 731/1491] 10.222.0.17 () {54 vars in 927 bytes} [Wed Sep 7 14:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:42:02.781373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f49af8-29fe-4f72-a0e1-4ae3a6710800 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:42:02.781826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f49af8-29fe-4f72-a0e1-4ae3a6710800 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:42:02.781940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f49af8-29fe-4f72-a0e1-4ae3a6710800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:42:02.848969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-50f49af8-29fe-4f72-a0e1-4ae3a6710800 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:42:02.851243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-50f49af8-29fe-4f72-a0e1-4ae3a6710800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:42:02.955407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 761/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Sep 7 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:42:03.243311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6059-7dd3-4a7f-bde5-7c61557bc3a9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:42:03.244993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d8ed6059-7dd3-4a7f-bde5-7c61557bc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:42:03.356776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6059-7dd3-4a7f-bde5-7c61557bc3a9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:42:03.437200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:42:03.437825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:42:03.438115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:42:03.438396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:42:03.440073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:42:03.450413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:42:03.558750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:42:03.560941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1b117-a16f-424e-a30f-b0533a14868c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:42:03.579311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 732/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:42:12.953594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=82 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:42:13.577355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=50 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:26.071399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:26.071991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:26.071991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:26.155938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:43:26.157524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:26.257900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 762/1494] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:43:26.266665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:26.267170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:26.267314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:26.356290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:43:26.357504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:26.453301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 733/1495] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:43:26.458250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:26.459482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:26.471384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c19b6-6a44-4aa9-95b5-b5450d98fdd7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:26.533744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:26.567612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:26.568217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:26.568499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:26.568773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:26.569415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:43:26.569731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:26.570746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:26.570746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:43:26.570746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:43:26.571659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:26.583716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 763/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:43:26.592755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:26.602318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398af31b-6884-48e1-b294-4d7a30893619 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:26.672302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:26.710742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:26.711401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:26.711690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:26.711962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:26.712607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:26.715005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:26.715005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:43:26.715005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:43:26.716278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:26.918223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 734/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:43:26 2022] POST /identity/v3/projects => generated 375 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:43:26.922636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:26.924257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:26.959943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cdb7-70ef-4e07-8f9b-103af7ea36c9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:27.062217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:27.062826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.063110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.063397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.064060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:27.065088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:27.065088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:43:27.065088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:43:27.066301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:27.173618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 764/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:43:26 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:43:27.177538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:27.179051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:27.243478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fede2-92e9-43f7-b0af-5d3a4db4f97d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:27.327944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:27.338899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:27.339613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.339895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.340171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.340813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:27.341825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:27.341825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:43:27.341825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:43:27.342738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:27.355895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 735/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:43:27.360022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:27.361534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:27.373333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762cfcb-7941-4ae1-832a-e33ac374d7df admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:27.398909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:27.471958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:27.472483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.472764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.473037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.473671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:27.474683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:27.474683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:43:27.474683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:43:27.475601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892c5e1-2e0f-47c8-a375-b8eb08a51574 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:27.488246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 765/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:43:27.492394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:27.493956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:27.528468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106fcf-1d57-4229-af80-f94631c1cafc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:27.622963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:27.623656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.623941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.624218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] PATH_INFO: `/v3/projects/144cf56608f443c3a44abeb76d208564/users/f2ec401b427449e084edbb15a4584fc6/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.647027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144cf56608f443c3a44abeb76d208564, user_id=f2ec401b427449e084edbb15a4584fc6, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:27.648264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:27.648264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:43:27.648264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:43:27.650213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a872c45-48d4-4076-9cce-132af5bca2f5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:27.747567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 736/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:43:27 2022] PUT /identity/v3/projects/144cf56608f443c3a44abeb76d208564/users/f2ec401b427449e084edbb15a4584fc6/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:43:27.759540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845450-1df4-454c-a48d-e78350dca3d4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.759824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845450-1df4-454c-a48d-e78350dca3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.760134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845450-1df4-454c-a48d-e78350dca3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.816969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-40845450-1df4-454c-a48d-e78350dca3d4 None None] MFA Rules not processed for user `f2ec401b427449e084edbb15a4584fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:43:27.818171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-40845450-1df4-454c-a48d-e78350dca3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:27.897214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 766/1502] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:43:27.910625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b875-6453-4e62-8220-13b0feda9a19 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.910918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b875-6453-4e62-8220-13b0feda9a19 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.911200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b875-6453-4e62-8220-13b0feda9a19 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.912600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 737/1503] 10.222.0.17 () {54 vars in 964 bytes} [Wed Sep 7 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:43:27.917715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcdf71-6fd5-48ac-b0f6-fc50a3201b2a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:27.918003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcdf71-6fd5-48ac-b0f6-fc50a3201b2a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:27.918281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcdf71-6fd5-48ac-b0f6-fc50a3201b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:27.952554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:27.998047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d9bcdf71-6fd5-48ac-b0f6-fc50a3201b2a None None] MFA Rules not processed for user `95f7c352378a4bc08f1d1acddae20cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:43:27.999164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d9bcdf71-6fd5-48ac-b0f6-fc50a3201b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:28.079549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 767/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Sep 7 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:43:28.087660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b875-6453-4e62-8220-13b0feda9a19 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:28.089186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d6d6b875-6453-4e62-8220-13b0feda9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:28.144047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:28.200225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b875-6453-4e62-8220-13b0feda9a19 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:28.273941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:28.274558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:28.276104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:28.276104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:28.276861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:28.375611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:28.377065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:28.380487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:28.395614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 738/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:43:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:43:28.441729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1b02-97bd-454c-8b07-2f02d8a7a733 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:28.442166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1b02-97bd-454c-8b07-2f02d8a7a733 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:28.442274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1b02-97bd-454c-8b07-2f02d8a7a733 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:28.443587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 768/1506] 10.222.0.17 () {52 vars in 830 bytes} [Wed Sep 7 14:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:43:28.447329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:28.448860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:28.548076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b90ac-d8f8-472e-bb8d-c44033fedc19 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:28.640863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:28.641501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:28.641784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:28.642063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] PATH_INFO: `/v3/users/f2ec401b427449e084edbb15a4584fc6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:28.654822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ec401b427449e084edbb15a4584fc6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:28.655873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:28.655873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:43:28.655873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:43:28.657105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:28.667719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:28.852784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ec401b427449e084edbb15a4584fc6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:28.853162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ec401b427449e084edbb15a4584fc6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:28.870456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ec401b427449e084edbb15a4584fc6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:28.894736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ec401b427449e084edbb15a4584fc6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:28.895325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ec401b427449e084edbb15a4584fc6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:28.946905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 739/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:43:28 2022] DELETE /identity/v3/users/f2ec401b427449e084edbb15a4584fc6 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:43:28.957736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:28.958029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:28.958311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:29.020568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:43:29.021778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:29.099238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:29.111776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 769/1508] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:43:29.121897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:29.123123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:29.222952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892bd04-6015-4c6a-889b-6b785578bf69 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:29.279257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:29.297852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:29.303357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:29.303357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:29.303357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:29.303357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:29.411125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:29.412519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d369-cf99-4b49-aa3a-1f27d6e1ca45 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:29.431241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 740/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:43:29.857931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:43:29.860937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:43:29.870798 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4d9c4-badf-4134-85d1-9697d904a4ea None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:43:29.969354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:43:29.969971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:43:29.970258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:43:29.970526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] PATH_INFO: `/v3/projects/144cf56608f443c3a44abeb76d208564` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:43:29.981505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=144cf56608f443c3a44abeb76d208564)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:43:29.982525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:43:29.982525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:43:29.982525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:43:29.983753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:43:30.090622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144cf56608f443c3a44abeb76d208564', 'request_id': 'req-71f3ad55-4404-4216-956d-e74fb1353f25'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:30.158394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144cf56608f443c3a44abeb76d208564', 'request_id': 'req-71f3ad55-4404-4216-956d-e74fb1353f25'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:30.165183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144cf56608f443c3a44abeb76d208564', 'request_id': 'req-71f3ad55-4404-4216-956d-e74fb1353f25'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:30.194898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] The token cache is being invalidate because project 144cf56608f443c3a44abeb76d208564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:43:30.195191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:30.195648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-71f3ad55-4404-4216-956d-e74fb1353f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:43:30.197047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 770/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:43:29 2022] DELETE /identity/v3/projects/144cf56608f443c3a44abeb76d208564 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:43:39.429017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=62 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:40.192987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:04.260925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771cfe-60c3-492e-a496-3f7e9a2e98ce None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:04.261535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771cfe-60c3-492e-a496-3f7e9a2e98ce None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:04.261535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d771cfe-60c3-492e-a496-3f7e9a2e98ce None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:04.262817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:04.267933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cdde2-2d05-40ab-a2ab-176a027afb02 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:04.268328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cdde2-2d05-40ab-a2ab-176a027afb02 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:04.268502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cdde2-2d05-40ab-a2ab-176a027afb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:04.350422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-652cdde2-2d05-40ab-a2ab-176a027afb02 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:04.351668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-652cdde2-2d05-40ab-a2ab-176a027afb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:04.454087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:04.618199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771cfe-60c3-492e-a496-3f7e9a2e98ce None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:04.620307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1d771cfe-60c3-492e-a496-3f7e9a2e98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:04.746445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d771cfe-60c3-492e-a496-3f7e9a2e98ce None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:04.752003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29ce7-6c8c-415e-bbd2-8fce43391df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:04.756584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29ce7-6c8c-415e-bbd2-8fce43391df8 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:04.756584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29ce7-6c8c-415e-bbd2-8fce43391df8 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:04.756584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29ce7-6c8c-415e-bbd2-8fce43391df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:04.761663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae29ce7-6c8c-415e-bbd2-8fce43391df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:04.763254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae29ce7-6c8c-415e-bbd2-8fce43391df8 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:04.773217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 742/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:05.867151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb4d3-8b00-490c-922c-6568b9d12ffc None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:05.867714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb4d3-8b00-490c-922c-6568b9d12ffc None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:05.867824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb4d3-8b00-490c-922c-6568b9d12ffc None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:05.869103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:05.875521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f6e7-40d7-498c-ad65-e12b8bcda669 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:05.875982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f6e7-40d7-498c-ad65-e12b8bcda669 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:05.876086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f6e7-40d7-498c-ad65-e12b8bcda669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:05.898598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a017f6e7-40d7-498c-ad65-e12b8bcda669 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:05.899771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a017f6e7-40d7-498c-ad65-e12b8bcda669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:05.907762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:06.063581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb4d3-8b00-490c-922c-6568b9d12ffc None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:06.078312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb4d3-8b00-490c-922c-6568b9d12ffc None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:06.084029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d8d0c-8551-4187-a985-f82cc7bc05f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:06.084627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d8d0c-8551-4187-a985-f82cc7bc05f7 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:06.084908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d8d0c-8551-4187-a985-f82cc7bc05f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:06.085185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d8d0c-8551-4187-a985-f82cc7bc05f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:06.093330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d8d0c-8551-4187-a985-f82cc7bc05f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:06.094917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d8d0c-8551-4187-a985-f82cc7bc05f7 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:06.104532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 773/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:06.360994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2c16-2ba6-4ace-a7a6-a8caacfd07bf None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:06.361284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2c16-2ba6-4ace-a7a6-a8caacfd07bf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:06.361587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2c16-2ba6-4ace-a7a6-a8caacfd07bf None None] PATH_INFO: `/v3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:06.362844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 744/1517] 10.222.0.23 () {54 vars in 925 bytes} [Wed Sep 7 14:45:06 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:45:06.368656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b508-6791-45ff-8eb1-fc1c52f1e55f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:06.368946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b508-6791-45ff-8eb1-fc1c52f1e55f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:06.369223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b508-6791-45ff-8eb1-fc1c52f1e55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:06.428763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-09c7b508-6791-45ff-8eb1-fc1c52f1e55f None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:06.429974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-09c7b508-6791-45ff-8eb1-fc1c52f1e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:06.447339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:06.506200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 774/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Sep 7 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:10.315844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e7cf-3790-4bd3-b551-f64fefdf2fe5 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:10.316325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e7cf-3790-4bd3-b551-f64fefdf2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:10.316443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e7cf-3790-4bd3-b551-f64fefdf2fe5 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:10.317717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 745/1519] 10.222.0.17 () {54 vars in 961 bytes} [Wed Sep 7 14:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:10.323285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644e8f-ecc6-4bf6-9344-af45bf7a3afb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:10.323731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644e8f-ecc6-4bf6-9344-af45bf7a3afb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:10.323886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644e8f-ecc6-4bf6-9344-af45bf7a3afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:10.344927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-81644e8f-ecc6-4bf6-9344-af45bf7a3afb None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:10.346134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-81644e8f-ecc6-4bf6-9344-af45bf7a3afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:10.355250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 775/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Sep 7 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:10.362779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e7cf-3790-4bd3-b551-f64fefdf2fe5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:10.376101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e7cf-3790-4bd3-b551-f64fefdf2fe5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:10.381610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af8234-a2a7-490e-a52d-07526f2366dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:10.382252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af8234-a2a7-490e-a52d-07526f2366dc service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:10.382475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af8234-a2a7-490e-a52d-07526f2366dc service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:10.382746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af8234-a2a7-490e-a52d-07526f2366dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:10.390673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af8234-a2a7-490e-a52d-07526f2366dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:10.392282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af8234-a2a7-490e-a52d-07526f2366dc service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:10.402198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 746/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:17.587811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d6d9-b2a1-4714-9867-412d718eb340 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:17.588384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d6d9-b2a1-4714-9867-412d718eb340 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:17.588384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d6d9-b2a1-4714-9867-412d718eb340 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:17.589720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:17.595877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ef75-cb77-4085-9e66-a8a35e32c732 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:17.596308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ef75-cb77-4085-9e66-a8a35e32c732 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:17.596437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ef75-cb77-4085-9e66-a8a35e32c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:17.616728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-08e4ef75-cb77-4085-9e66-a8a35e32c732 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:17.617928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-08e4ef75-cb77-4085-9e66-a8a35e32c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:17.625664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:17.782071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d6d9-b2a1-4714-9867-412d718eb340 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:17.797110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d6d9-b2a1-4714-9867-412d718eb340 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:17.802514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda3225-87b1-4a38-8ae3-f1cb8cbfa554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:17.803093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda3225-87b1-4a38-8ae3-f1cb8cbfa554 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:17.803394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda3225-87b1-4a38-8ae3-f1cb8cbfa554 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:17.803676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda3225-87b1-4a38-8ae3-f1cb8cbfa554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:17.811609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda3225-87b1-4a38-8ae3-f1cb8cbfa554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:17.813179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda3225-87b1-4a38-8ae3-f1cb8cbfa554 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:17.822573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 777/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:18.918619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15426-32ff-44f7-81db-3826729a23d1 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:18.919181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15426-32ff-44f7-81db-3826729a23d1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:18.919181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15426-32ff-44f7-81db-3826729a23d1 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:18.920557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 14:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:18.926933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317378-c42b-4d7a-abfb-fbef70e6629b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:18.928043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317378-c42b-4d7a-abfb-fbef70e6629b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:18.928263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317378-c42b-4d7a-abfb-fbef70e6629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:18.949162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9e317378-c42b-4d7a-abfb-fbef70e6629b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:18.950358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9e317378-c42b-4d7a-abfb-fbef70e6629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:18.958995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 14:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:19.113831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15426-32ff-44f7-81db-3826729a23d1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:19.127846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15426-32ff-44f7-81db-3826729a23d1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:19.133949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b472f85-ac9f-4731-9e8a-1672f0afb0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:19.134539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b472f85-ac9f-4731-9e8a-1672f0afb0ec service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:19.134817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b472f85-ac9f-4731-9e8a-1672f0afb0ec service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:19.135087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b472f85-ac9f-4731-9e8a-1672f0afb0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:19.150839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b472f85-ac9f-4731-9e8a-1672f0afb0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:19.152522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b472f85-ac9f-4731-9e8a-1672f0afb0ec service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:19.162047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 749/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:23.203488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60787d1-ac2b-4bc3-b8ea-1a9e83025df3 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:23.204028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60787d1-ac2b-4bc3-b8ea-1a9e83025df3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:23.204028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60787d1-ac2b-4bc3-b8ea-1a9e83025df3 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:23.205618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:23.211293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171bf64-d8ec-47a9-a345-b2184aae4ea3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:23.211747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171bf64-d8ec-47a9-a345-b2184aae4ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:23.211882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171bf64-d8ec-47a9-a345-b2184aae4ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:23.231494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8171bf64-d8ec-47a9-a345-b2184aae4ea3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:23.232693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8171bf64-d8ec-47a9-a345-b2184aae4ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:23.240916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:23.533755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60787d1-ac2b-4bc3-b8ea-1a9e83025df3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:23.535455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d60787d1-ac2b-4bc3-b8ea-1a9e83025df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:23.611262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60787d1-ac2b-4bc3-b8ea-1a9e83025df3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:23.614880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9358cc-7200-46d0-8e12-f21c1ea1c0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:23.615508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9358cc-7200-46d0-8e12-f21c1ea1c0bc service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:23.615788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9358cc-7200-46d0-8e12-f21c1ea1c0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:23.616059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9358cc-7200-46d0-8e12-f21c1ea1c0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:23.624734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9358cc-7200-46d0-8e12-f21c1ea1c0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:23.626156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9358cc-7200-46d0-8e12-f21c1ea1c0bc service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:23.635874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 780/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:25.981433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4121d-83b4-46b9-867d-cec0d334100c None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:25.981995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4121d-83b4-46b9-867d-cec0d334100c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:25.981995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4121d-83b4-46b9-867d-cec0d334100c None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:25.983625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:25.988631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3179d-9848-42a8-94b9-1c1bd2b54565 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:25.989655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3179d-9848-42a8-94b9-1c1bd2b54565 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:25.989775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3179d-9848-42a8-94b9-1c1bd2b54565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:26.009804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-63c3179d-9848-42a8-94b9-1c1bd2b54565 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:26.010991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-63c3179d-9848-42a8-94b9-1c1bd2b54565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:26.018668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:26.308969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4121d-83b4-46b9-867d-cec0d334100c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:26.310675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9ea4121d-83b4-46b9-867d-cec0d334100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:26.324904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4121d-83b4-46b9-867d-cec0d334100c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:26.328118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09d626-aafb-4f40-896d-0e1d4ffd252d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:26.328787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09d626-aafb-4f40-896d-0e1d4ffd252d service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:26.329317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09d626-aafb-4f40-896d-0e1d4ffd252d service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:26.329603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09d626-aafb-4f40-896d-0e1d4ffd252d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:26.339501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09d626-aafb-4f40-896d-0e1d4ffd252d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:26.341185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09d626-aafb-4f40-896d-0e1d4ffd252d service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:26.350882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 752/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:30.090129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0bd1-562e-4e5a-90ce-a4a0058cf774 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:30.090688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0bd1-562e-4e5a-90ce-a4a0058cf774 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:30.090688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c0bd1-562e-4e5a-90ce-a4a0058cf774 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:30.092045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:30.097426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703191be-3801-4de7-98c4-60fdcb5081f7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:30.097847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703191be-3801-4de7-98c4-60fdcb5081f7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:30.097987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703191be-3801-4de7-98c4-60fdcb5081f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:30.106028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:30.118753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-703191be-3801-4de7-98c4-60fdcb5081f7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:30.120163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-703191be-3801-4de7-98c4-60fdcb5081f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:30.128061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:45:30.432235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c0bd1-562e-4e5a-90ce-a4a0058cf774 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:30.433913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3b3c0bd1-562e-4e5a-90ce-a4a0058cf774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:30.498280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:30.511116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c0bd1-562e-4e5a-90ce-a4a0058cf774 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:30.519228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295baa4c-765b-4d64-a176-f6cbb4246fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:30.519228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295baa4c-765b-4d64-a176-f6cbb4246fac service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:30.519228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295baa4c-765b-4d64-a176-f6cbb4246fac service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:30.519228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295baa4c-765b-4d64-a176-f6cbb4246fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:30.525058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295baa4c-765b-4d64-a176-f6cbb4246fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:30.526484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295baa4c-765b-4d64-a176-f6cbb4246fac service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:30.536626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 783/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:32.717297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570db74-020c-44cb-a7b8-f6983dc12377 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:32.717873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570db74-020c-44cb-a7b8-f6983dc12377 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:32.717873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570db74-020c-44cb-a7b8-f6983dc12377 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:32.719187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 14:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:45:32.724628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b140-8cf8-47ee-925b-8c726ab9f7ae None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:32.725088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b140-8cf8-47ee-925b-8c726ab9f7ae None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:32.725186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b140-8cf8-47ee-925b-8c726ab9f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:32.745430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8926b140-8cf8-47ee-925b-8c726ab9f7ae None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:45:32.746707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8926b140-8cf8-47ee-925b-8c726ab9f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:32.755572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:45:33.062444 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570db74-020c-44cb-a7b8-f6983dc12377 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:45:33.064108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3570db74-020c-44cb-a7b8-f6983dc12377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:45:33.077574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570db74-020c-44cb-a7b8-f6983dc12377 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:45:33.081326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74176e-5450-4675-8342-497a7f1745fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:45:33.081917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74176e-5450-4675-8342-497a7f1745fc service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:45:33.082208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74176e-5450-4675-8342-497a7f1745fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:45:33.082519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74176e-5450-4675-8342-497a7f1745fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:45:33.091583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74176e-5450-4675-8342-497a7f1745fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:45:33.092997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74176e-5450-4675-8342-497a7f1745fc service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:45:33.103142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 755/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:45:42.740021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=11 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:43.098109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=8 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:01.216979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.216979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.216979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.234834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.236106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.251659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 785/1540] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.260511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.261129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.261129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.293384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.294616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.315994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 756/1541] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.322401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:01.340614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5684d28-3dba-4ccf-bdef-88389f6c5b91 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:01.346815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:01.349700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.350171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.350617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.351564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:01.352045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:01.354152 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:01.376057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 786/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:47:01.385025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:01.398203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d6d8-9aea-4ff9-b0e9-e7f0545c56cb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:01.406565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dadd54-76e2-4b7c-8256-4e75ebf952f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:01.407201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dadd54-76e2-4b7c-8256-4e75ebf952f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.407520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dadd54-76e2-4b7c-8256-4e75ebf952f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.407802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dadd54-76e2-4b7c-8256-4e75ebf952f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.408472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dadd54-76e2-4b7c-8256-4e75ebf952f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:01.411366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dadd54-76e2-4b7c-8256-4e75ebf952f3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:01.544186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 757/1543] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/projects => generated 359 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:47:01.548891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:01.561214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f395b-f1c3-4d33-bbe3-7a1f171c6b45 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:01.578001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6767a-a299-4b92-9b40-7cbaf04f28db None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.578353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6767a-a299-4b92-9b40-7cbaf04f28db None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.578577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6767a-a299-4b92-9b40-7cbaf04f28db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.611126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5ff6767a-a299-4b92-9b40-7cbaf04f28db None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.613808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5ff6767a-a299-4b92-9b40-7cbaf04f28db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.671421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b9c0c-c6be-4cd1-81a0-a0aa826ed405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:01.672160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b9c0c-c6be-4cd1-81a0-a0aa826ed405 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.672649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b9c0c-c6be-4cd1-81a0-a0aa826ed405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.672930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b9c0c-c6be-4cd1-81a0-a0aa826ed405 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.673572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b9c0c-c6be-4cd1-81a0-a0aa826ed405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:01.676735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b9c0c-c6be-4cd1-81a0-a0aa826ed405 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:01.719065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 758/1544] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.719324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74da78-5c86-4be9-a311-bfe3783d3229 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.719923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74da78-5c86-4be9-a311-bfe3783d3229 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.720208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74da78-5c86-4be9-a311-bfe3783d3229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.741624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ad74da78-5c86-4be9-a311-bfe3783d3229 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.742808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad74da78-5c86-4be9-a311-bfe3783d3229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.750882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 759/1545] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.752225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0108-00f0-4546-9bcf-b87026a9fe6e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.752519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0108-00f0-4546-9bcf-b87026a9fe6e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.752796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0108-00f0-4546-9bcf-b87026a9fe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.760517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 787/1546] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/users => generated 280 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:01.763858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009c178-d605-427b-97e0-e0184351917f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.763858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009c178-d605-427b-97e0-e0184351917f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.763858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009c178-d605-427b-97e0-e0184351917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.773984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-773b0108-00f0-4546-9bcf-b87026a9fe6e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.775190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-773b0108-00f0-4546-9bcf-b87026a9fe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.782728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9009c178-d605-427b-97e0-e0184351917f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.783179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 760/1547] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.783993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9009c178-d605-427b-97e0-e0184351917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.784535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd47b-ca15-43ad-bd66-b4eba7ccaf32 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.784822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd47b-ca15-43ad-bd66-b4eba7ccaf32 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.785105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd47b-ca15-43ad-bd66-b4eba7ccaf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.792091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 788/1548] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.793301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a856581-d934-4be7-b5d6-94503b4060d2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.793586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a856581-d934-4be7-b5d6-94503b4060d2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.793865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a856581-d934-4be7-b5d6-94503b4060d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.805830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-32dbd47b-ca15-43ad-bd66-b4eba7ccaf32 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.806955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-32dbd47b-ca15-43ad-bd66-b4eba7ccaf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.813070 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1a856581-d934-4be7-b5d6-94503b4060d2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.814227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a856581-d934-4be7-b5d6-94503b4060d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.815133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 761/1549] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.816283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c52ca-5be8-4e74-85fd-1e8ef1676c63 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.817122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c52ca-5be8-4e74-85fd-1e8ef1676c63 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.817457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c52ca-5be8-4e74-85fd-1e8ef1676c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.830380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 789/1550] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.831666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.832733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.832733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.841263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-642c52ca-5be8-4e74-85fd-1e8ef1676c63 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.842508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-642c52ca-5be8-4e74-85fd-1e8ef1676c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.851140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 762/1551] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.861484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efdf3-ebd0-4904-bc20-afbff7e8795d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.861484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efdf3-ebd0-4904-bc20-afbff7e8795d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.861484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efdf3-ebd0-4904-bc20-afbff7e8795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.861834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.861834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.866996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 790/1552] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.867702 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:01.876647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-052efdf3-ebd0-4904-bc20-afbff7e8795d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.882715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-052efdf3-ebd0-4904-bc20-afbff7e8795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.882956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab583-a11e-4d02-8837-e797034f623f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:01.885165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dbcc2-235b-402e-b529-71c53b677843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:01.885819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dbcc2-235b-402e-b529-71c53b677843 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.886162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dbcc2-235b-402e-b529-71c53b677843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.886511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dbcc2-235b-402e-b529-71c53b677843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.886928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 763/1553] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.887465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dbcc2-235b-402e-b529-71c53b677843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:01.888214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85311c-e84a-4bb8-aa81-7f1660109a1d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.888571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85311c-e84a-4bb8-aa81-7f1660109a1d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.888789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85311c-e84a-4bb8-aa81-7f1660109a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.890417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dbcc2-235b-402e-b529-71c53b677843 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:01.909603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 791/1554] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:01.909603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e52b-c201-4925-8d36-253d377eac42 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.909603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e52b-c201-4925-8d36-253d377eac42 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.909966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e52b-c201-4925-8d36-253d377eac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.913288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-dc85311c-e84a-4bb8-aa81-7f1660109a1d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.915190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dc85311c-e84a-4bb8-aa81-7f1660109a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.927856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 764/1555] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.929832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448de3a-5c6d-448e-83dc-51e1cd664bb1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.930302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448de3a-5c6d-448e-83dc-51e1cd664bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.930991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448de3a-5c6d-448e-83dc-51e1cd664bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.940847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3352e52b-c201-4925-8d36-253d377eac42 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.944244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3352e52b-c201-4925-8d36-253d377eac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.953893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 792/1556] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.955166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.955510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.955794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.958127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2448de3a-5c6d-448e-83dc-51e1cd664bb1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.959324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2448de3a-5c6d-448e-83dc-51e1cd664bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.967172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 765/1557] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.968401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:01.968690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:01.968966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:01.978309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.980342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.987742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:01.989490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:01.990700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 793/1558] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.991576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:01.997550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 766/1559] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:01.998353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.001909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5f42a-b57a-491f-9324-c101c8aaff25 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.007474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.008073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.008355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.008471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96badaa2-59bf-444e-9cfe-0c1ee84f7b64 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.008629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.009277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.009588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.011191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.012943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.013539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.013848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.014126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.014807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.015250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.016290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:47:02.016290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:47:02.016290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:47:02.017175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.030271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 794/1560] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.030926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 767/1561] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.036151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.036694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.046517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5897-8de5-472d-938e-84359078aa01 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.047507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e356d3-8313-4452-9b68-b12a9053f3ad admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.054439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.054439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.054439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.054785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.054898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.055036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.055131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.055236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.055336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.055448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.055448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.055608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.056012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.067745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 768/1562] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.068899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.075526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 795/1563] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:02.075526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.079337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312b026-186a-4d88-95a5-4b922891361c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.082376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf462-9122-4545-a158-1c18b9b6a08f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.084125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.084734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.085019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.085298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.085942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.086248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.087361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.087878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.088002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.088249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.088524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.089156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.089463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.091036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.099757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 769/1564] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.100531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.109872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 796/1565] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.110147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08932-0976-49af-9588-e18275dc956d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.110795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.115797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.116561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.116854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.117134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.118220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.118220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.119915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.122192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67b95-e0a6-4ff1-841b-0e966c0c84a8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.127071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.127810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.128088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.128355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.129105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:02.129405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.131114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.132668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 770/1566] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.133457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.143571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8f24-31cc-4341-96e7-ea0ab503dbfc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.151577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 797/1567] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:02.151577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.151847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.151847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.151847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.151847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.152212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.153571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.155772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e0fe-3e8b-4be3-a3d5-4c8f00cfcda5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.160419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.161044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.161317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.161597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.162215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.163217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:47:02.163217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:47:02.163217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:47:02.164441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.169059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:02.254460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 771/1568] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.254684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 798/1569] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.255490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.256064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.272145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:02.320843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230829bf-958c-40e2-8cbf-c8e648290c57 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.321709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971e31c-a81d-4b93-b456-503880b2ccb2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.325540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.326148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.326354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.326477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.326700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.327013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.327339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.327766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.328056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] PATH_INFO: `/v3/projects/aa9bdf9f911e43a696471cb277f1c902/users/75e9f1afe1c34c40a5786b9cf1ea921a/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.329528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.344211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9bdf9f911e43a696471cb277f1c902, user_id=75e9f1afe1c34c40a5786b9cf1ea921a, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.345333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:47:02.345333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:47:02.345333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:47:02.347351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.421963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 772/1570] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.422761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.450186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 799/1571] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:02 2022] PUT /identity/v3/projects/aa9bdf9f911e43a696471cb277f1c902/users/75e9f1afe1c34c40a5786b9cf1ea921a/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:02.451320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.486839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f701-73c8-46bb-be0f-a7eecb6ce805 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.520646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a642ea-d986-4705-873b-9b44c52d91b9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.525263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.525869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.526153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.526431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.527065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.529029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.543879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.544498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.544786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.545062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.545702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.547631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.645480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 800/1572] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.646382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.655287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 773/1573] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.656208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.669469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:02.708599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f0c9-ba57-4aa2-8883-70fea0c71521 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.720256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4884e-0d70-441a-bcbd-9fe840fd2286 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.725185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.727520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.727520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.727520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.727520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.729054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.734497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:02.764363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.764968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.765250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.765525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.766154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.768149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.836446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 774/1574] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.837345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.863279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 801/1575] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:02.864391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:02.902509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80b0b-f10e-4f66-a0e2-c61d02c1482f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.940954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb0e5d-ecaa-4c91-9c9c-0a2bd4618114 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:02.947975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.948619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.948909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.949646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.950352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.952364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:02.969326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:02.970006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:02.970299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:02.970574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:02.971234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:02.972260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:47:02.972260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:47:02.972260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:47:02.973993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4f6e5-bc86-4822-84fd-4ca651f85a19 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.064802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 802/1576] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.065767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.077291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfb62b-525e-4bc4-a7d5-77825c956aa7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.082665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.083337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.083656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.083929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.084547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.086531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.093432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 775/1577] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:02 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.094746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.100755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.100755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.122542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] MFA Rules not processed for user `75e9f1afe1c34c40a5786b9cf1ea921a`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:03.131333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:03.149042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:03.188760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 776/1578] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:03.189495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.200564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1d5a0-227b-4cf2-8317-b273a28904a7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.206300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.206900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.207930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.208225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.208909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.210794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 803/1579] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.210919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.214680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.224792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87593-9e29-4f65-9b77-c3a7e417633d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.229436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.230030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.230312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.230587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.231212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.233250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.339297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 804/1580] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.340211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.340375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 777/1581] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.341256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.351088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd323abc-772f-460e-897a-16a2bd69dc19 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.352423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5ef72-a6d6-4a25-a672-e72565271104 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.355824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.356430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.356713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.356991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.357142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.357626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.357749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.358013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.358290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.358920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.359576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.360904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.444523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 805/1582] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.445347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.455129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed825777-c2fb-4fd8-8e72-4a57d848c2e6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.459883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.460448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.460736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.461012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.461648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.463246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.468031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 778/1583] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.468031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.477596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 806/1584] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.477596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.479951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8c2e5-b4e6-4d75-a73a-1b380cf96c22 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.484734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.485348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.485628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.485736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa21ba6-7794-450f-8563-e148d2956a1c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.485900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.486537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.488192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.491466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.492053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.492337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.492614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.493297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.495165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.499186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 779/1585] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.502344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.510126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dacfc-2a74-4e59-8386-709026bc25fa admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.514649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.515228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.515534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.515808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.516429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.518052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.527686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 780/1586] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.528452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.537415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a69c-2816-428b-a2e9-2002346d0c65 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.541907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.542437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.542719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.542990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.543622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.545128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.555726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 781/1587] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.556778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.565996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a74e0-27c4-4dd8-9dc0-1353b3f100eb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.571355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.576009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.576161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 807/1588] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.576273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.576273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.576456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.576557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.576557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.589052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 782/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.589052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.594818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:03.596768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ae666-08b1-4f90-887b-90e673af41bb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.639440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be35ba-aa09-41bf-9a79-8e749ed33c6d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.644502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.645359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.645651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.645932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.646608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.648285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.654040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.654753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.655041 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.655314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.655991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.657588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.658281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 808/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.659110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.667943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 783/1591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.668782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.669828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8512f-eaae-4c56-ba11-8911f54c56d1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.674651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.675354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.676471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.676986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.678075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.678824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681927-c647-4bf0-98f3-96a3dba4b13e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.681153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.684554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.686815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.687105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.687399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.688048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.689613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.694868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 809/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.695738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.706507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 784/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.706507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.710888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431b27-9ea4-40fe-8e0f-024d15e10fe5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.714117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307c399-6081-4657-aa68-578ad0776cca admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.715825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.716426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.716711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.716989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.717627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.719022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.719233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.719785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.720082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.720342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.720977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.723415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.730622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 810/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.731482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.734867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 785/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.735799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.741703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e93c-9ebd-4c62-9084-667b8526616b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.746112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.746471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6edd-e73e-402b-9061-2d5d31962a69 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.746690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.746968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.747243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.747893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.749827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.751213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.751817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.752147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.752369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.752997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.755106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.765129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 786/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.766072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.775821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a22f8-238e-4c71-96b2-bae6f9bec880 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.780341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.780901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.781183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.781457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.782077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.783655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.786405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:03.794392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 787/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.795123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.805194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e516911-3a98-43fa-a62e-3452d60bcd45 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.810260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.810986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.811414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.811741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.812404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.814149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.824119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 788/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:03.824989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.834346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4324d0-95fb-4a73-85da-54b4872dcec6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.839030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.839638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.844950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.844950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] PATH_INFO: `/v3/projects/d37c9fb1839a4ca290d4b2849bb6c1d3/users/4fd98abc30e940728d3810a4369b6784/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.845212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 811/1599] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:03 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:03.845212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.853475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9245-08bf-47b6-99fc-537aecead219 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:03.858129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37c9fb1839a4ca290d4b2849bb6c1d3, user_id=4fd98abc30e940728d3810a4369b6784, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.858255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:03.858774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:03.859058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:03.859334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] PATH_INFO: `/v3/projects/93d0d6d7c537400fbc8c3216325b6bbb/users/4166ed1a661943dc90ab68cf8c386f35/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:03.860825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.876115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d0d6d7c537400fbc8c3216325b6bbb, user_id=4166ed1a661943dc90ab68cf8c386f35, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:03.878772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:03.959898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 812/1600] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:03 2022] PUT /identity/v3/projects/93d0d6d7c537400fbc8c3216325b6bbb/users/4166ed1a661943dc90ab68cf8c386f35/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:03.960074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 789/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:03 2022] PUT /identity/v3/projects/d37c9fb1839a4ca290d4b2849bb6c1d3/users/4fd98abc30e940728d3810a4369b6784/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:03.961145 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:03.961611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.031247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57c503-f6f4-417b-b3c4-07ea0bb0679a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.033237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44702-447f-49a0-91fe-c77b44741fdd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.036700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.037361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.037646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.037925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] PATH_INFO: `/v3/projects/0b28ea73f24342548dde1f1cd12c9a21/users/5e048d74b095442f97f26d57f823123f/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.038496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.039150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.039473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.039756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] PATH_INFO: `/v3/projects/43a3881e45ef47e9b43162089c1273cd/users/7207cf1f839b471bb0bff5648534cfa2/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.052692 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28ea73f24342548dde1f1cd12c9a21, user_id=5e048d74b095442f97f26d57f823123f, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.055067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a3881e45ef47e9b43162089c1273cd, user_id=7207cf1f839b471bb0bff5648534cfa2, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.055334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.057767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.151316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 790/1602] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:03 2022] PUT /identity/v3/projects/0b28ea73f24342548dde1f1cd12c9a21/users/5e048d74b095442f97f26d57f823123f/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:04.152241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.163115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 813/1603] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:03 2022] PUT /identity/v3/projects/43a3881e45ef47e9b43162089c1273cd/users/7207cf1f839b471bb0bff5648534cfa2/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:04.164667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.199193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:04.218142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24119-d10f-4155-acbc-b5f615d39765 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.224073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.224759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.225048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.225332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] PATH_INFO: `/v3/projects/212e4e6fbb3145e8a03b2349f1c3e21d/users/7826fd64387546a3a4be1f4d04b070c2/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.228546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc6e1-c7d4-492c-a8b7-0c568a79e113 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.233563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.234219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.234500 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.234786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] PATH_INFO: `/v3/projects/435ade9a652147b89b8f6f3087041313/users/7a942ca036c1425795d7627589472a75/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.241848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212e4e6fbb3145e8a03b2349f1c3e21d, user_id=7826fd64387546a3a4be1f4d04b070c2, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.244759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.249777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435ade9a652147b89b8f6f3087041313, user_id=7a942ca036c1425795d7627589472a75, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.252456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.346419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 791/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:04 2022] PUT /identity/v3/projects/212e4e6fbb3145e8a03b2349f1c3e21d/users/7826fd64387546a3a4be1f4d04b070c2/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:04.347219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.358634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 814/1605] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:04 2022] PUT /identity/v3/projects/435ade9a652147b89b8f6f3087041313/users/7a942ca036c1425795d7627589472a75/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:04.359733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.385903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:04.421887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e9b2-ec3c-41b1-9951-70908d25ea87 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.437174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd25d-e19e-4441-8c3b-0e8b53fa91c0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.443074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbf96-0120-4849-a83e-84e58ad660fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.444557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbf96-0120-4849-a83e-84e58ad660fe admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.445016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbf96-0120-4849-a83e-84e58ad660fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.445996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbf96-0120-4849-a83e-84e58ad660fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.446802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbf96-0120-4849-a83e-84e58ad660fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.449075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbf96-0120-4849-a83e-84e58ad660fe admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.460568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 815/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:04.464925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550a1ff-0a32-48d0-8462-ed928b9882e0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.465217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550a1ff-0a32-48d0-8462-ed928b9882e0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.465489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550a1ff-0a32-48d0-8462-ed928b9882e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.484726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3550a1ff-0a32-48d0-8462-ed928b9882e0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.485858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3550a1ff-0a32-48d0-8462-ed928b9882e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:04.491424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f0f95-0914-4759-aa75-c3e9608221f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.491424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f0f95-0914-4759-aa75-c3e9608221f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.491424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f0f95-0914-4759-aa75-c3e9608221f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.491424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f0f95-0914-4759-aa75-c3e9608221f9 admin admin] PATH_INFO: `/v3/projects/717860d1fe9a4e84958b88a3ec1974e5/users/043a6435674346aaa31dd842f8e12f39/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.493855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 816/1607] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:04.495042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba30e06-fe5e-4125-b004-aa4ef7647b87 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.495325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba30e06-fe5e-4125-b004-aa4ef7647b87 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.495628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba30e06-fe5e-4125-b004-aa4ef7647b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.513411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f0f95-0914-4759-aa75-c3e9608221f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717860d1fe9a4e84958b88a3ec1974e5, user_id=043a6435674346aaa31dd842f8e12f39, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.514963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f0f95-0914-4759-aa75-c3e9608221f9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.531965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-dba30e06-fe5e-4125-b004-aa4ef7647b87 None None] MFA Rules not processed for user `4166ed1a661943dc90ab68cf8c386f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.533260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-dba30e06-fe5e-4125-b004-aa4ef7647b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:04.587539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 792/1608] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:04 2022] PUT /identity/v3/projects/717860d1fe9a4e84958b88a3ec1974e5/users/043a6435674346aaa31dd842f8e12f39/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:04.589056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16150118-c275-408f-b832-4a6d9cd733c3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.589417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16150118-c275-408f-b832-4a6d9cd733c3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.589763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16150118-c275-408f-b832-4a6d9cd733c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.603054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 817/1609] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:04.605201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7158-e772-4146-98b1-5bc6f59846f2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.605719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7158-e772-4146-98b1-5bc6f59846f2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.606179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7158-e772-4146-98b1-5bc6f59846f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.612940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-16150118-c275-408f-b832-4a6d9cd733c3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.615609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-16150118-c275-408f-b832-4a6d9cd733c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:04.629987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-89bb7158-e772-4146-98b1-5bc6f59846f2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.631507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-89bb7158-e772-4146-98b1-5bc6f59846f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:04.671237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:04.707432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 793/1610] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:04.708315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.708809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.709283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.724546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 818/1611] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:04.726836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.727347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.727840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.751687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] MFA Rules not processed for user `7826fd64387546a3a4be1f4d04b070c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.753147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:04.764895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] MFA Rules not processed for user `7a942ca036c1425795d7627589472a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.766116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:04.806969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:04.824880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 794/1612] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:04.825786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.837809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 819/1613] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:04.842507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.842633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5caae-229f-4a2b-be44-0b4dd6bbbaa0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.844204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71929fc-661e-4efe-8dff-ee2351388500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.844865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71929fc-661e-4efe-8dff-ee2351388500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.845164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71929fc-661e-4efe-8dff-ee2351388500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.845429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71929fc-661e-4efe-8dff-ee2351388500 admin admin] PATH_INFO: `/v3/projects/ba80b4b105e44147934a7cf28cfacb59/users/168304edec4848d3b8ca12dfb90ac000/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.861124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71929fc-661e-4efe-8dff-ee2351388500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba80b4b105e44147934a7cf28cfacb59, user_id=168304edec4848d3b8ca12dfb90ac000, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.863864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71929fc-661e-4efe-8dff-ee2351388500 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.903680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550578e-a3be-43c4-930f-d8eab235a3c7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:04.907245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289a19-8735-4bd7-ae98-a3aa4a2cd643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:04.907872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289a19-8735-4bd7-ae98-a3aa4a2cd643 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.908147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289a19-8735-4bd7-ae98-a3aa4a2cd643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.908417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289a19-8735-4bd7-ae98-a3aa4a2cd643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.917740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289a19-8735-4bd7-ae98-a3aa4a2cd643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:04.919179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289a19-8735-4bd7-ae98-a3aa4a2cd643 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:04.929004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 820/1614] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:04.930003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.930285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.930556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.944967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 795/1615] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:04 2022] PUT /identity/v3/projects/ba80b4b105e44147934a7cf28cfacb59/users/168304edec4848d3b8ca12dfb90ac000/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:04.944967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5648c8-de14-4fdc-b52c-2de98eb58b38 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:04.944967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5648c8-de14-4fdc-b52c-2de98eb58b38 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:04.944967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5648c8-de14-4fdc-b52c-2de98eb58b38 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:04.946021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 796/1616] 10.222.0.17 () {54 vars in 962 bytes} [Wed Sep 7 14:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:04.946984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5648c8-de14-4fdc-b52c-2de98eb58b38 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:04.953273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:04.955063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:05.014423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5648c8-de14-4fdc-b52c-2de98eb58b38 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.019107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416244e-4852-42ba-8d2f-09eef342a74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.020467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416244e-4852-42ba-8d2f-09eef342a74d service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.020467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416244e-4852-42ba-8d2f-09eef342a74d service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.020702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416244e-4852-42ba-8d2f-09eef342a74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.031645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 821/1617] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:05.032322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.043008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670400-fdbf-41fd-b156-bfc9b6ba7730 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.047407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.048027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.048262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.048563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.057181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:05.059604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.061066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.072274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 822/1618] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:05.075008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.083210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa01e-50e1-4609-bdf1-52873bbe8221 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.089854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.090415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.090697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.090975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.092659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.094723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.099066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416244e-4852-42ba-8d2f-09eef342a74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.100568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416244e-4852-42ba-8d2f-09eef342a74d service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.113067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 797/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:05.114915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cccc4f-b0ea-4c87-aaf2-7b5af3c18796 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.115195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cccc4f-b0ea-4c87-aaf2-7b5af3c18796 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.115497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cccc4f-b0ea-4c87-aaf2-7b5af3c18796 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.116735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 798/1620] 10.222.0.17 () {54 vars in 962 bytes} [Wed Sep 7 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:05.117420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cccc4f-b0ea-4c87-aaf2-7b5af3c18796 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.131408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cccc4f-b0ea-4c87-aaf2-7b5af3c18796 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.136555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457abb-b69c-4006-8cb2-3870de930975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.137162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457abb-b69c-4006-8cb2-3870de930975 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.137443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457abb-b69c-4006-8cb2-3870de930975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.137739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457abb-b69c-4006-8cb2-3870de930975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.138377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7457abb-b69c-4006-8cb2-3870de930975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.140001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7457abb-b69c-4006-8cb2-3870de930975 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.157167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 799/1621] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:05.157167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943230-70e6-463d-a1c3-643ff7625ac9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.157167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943230-70e6-463d-a1c3-643ff7625ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.157167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943230-70e6-463d-a1c3-643ff7625ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.194331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c3943230-70e6-463d-a1c3-643ff7625ac9 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:05.195615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c3943230-70e6-463d-a1c3-643ff7625ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:05.236211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 823/1622] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:05.236211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.274768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 800/1623] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Sep 7 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:05.274768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.274768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.274768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.297849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:05.299176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da0dd-98f6-43e6-a1c6-816a5633aee0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.299346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:05.303995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.304726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.305316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.305316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.373094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:05.380746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.382373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.385373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 801/1624] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Sep 7 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:05.386384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.393858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 824/1625] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:05.395398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.405206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6960-3bef-4cc3-8e23-3668952a180f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.407016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac030388-66b0-4a2c-9681-7f09083a043f service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.411278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.412085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.412349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.412505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.412775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.413042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.413329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.413454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.413606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] PATH_INFO: `/v3/projects/ba80b4b105e44147934a7cf28cfacb59/users/168304edec4848d3b8ca12dfb90ac000/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.416064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba80b4b105e44147934a7cf28cfacb59, user_id=168304edec4848d3b8ca12dfb90ac000, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.416199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.419713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.431445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 802/1626] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:05 2022] PUT /identity/v3/projects/ba80b4b105e44147934a7cf28cfacb59/users/168304edec4848d3b8ca12dfb90ac000/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:05.435691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.521278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f52e8-874d-4269-81b7-1b1089d5ecbb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.525279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 825/1627] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:05 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:05.526298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.530964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84082e5-7f13-4d25-95be-1032b55e3641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.531844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84082e5-7f13-4d25-95be-1032b55e3641 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.532251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84082e5-7f13-4d25-95be-1032b55e3641 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.532620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84082e5-7f13-4d25-95be-1032b55e3641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.543603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1386d00-8a8d-40c1-aab6-a38562fc027c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.552764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.553761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.553927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.554236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.627805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84082e5-7f13-4d25-95be-1032b55e3641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.629592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84082e5-7f13-4d25-95be-1032b55e3641 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.631848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.633127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:05.633426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.638890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 803/1628] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:05.642671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 826/1629] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:05.648245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.648609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.648902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.649185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.655541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:05.683457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] MFA Rules not processed for user `168304edec4848d3b8ca12dfb90ac000`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:05.684693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:05.760459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ff42-346e-48c8-9d2c-53ac1254c5d1 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.770553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.770896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.771178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.771730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.772622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.775680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.802876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 827/1630] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:05.803739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.825037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 804/1631] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:05.825394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3fc3-4b2f-49c7-9ccf-a89076a19da3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.837124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d43c46-f8e4-44e7-b60c-fe35c6f7a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.837124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43c46-f8e4-44e7-b60c-fe35c6f7a94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.837124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43c46-f8e4-44e7-b60c-fe35c6f7a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.837124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43c46-f8e4-44e7-b60c-fe35c6f7a94a admin admin] PATH_INFO: `/v3/projects/c3724bf1454840eba3f2a19e0d2dc5cf/users/dac2a5bcb14c4895a92de1835337c984/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.840329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.879486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d43c46-f8e4-44e7-b60c-fe35c6f7a94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3724bf1454840eba3f2a19e0d2dc5cf, user_id=dac2a5bcb14c4895a92de1835337c984, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:05.882345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d43c46-f8e4-44e7-b60c-fe35c6f7a94a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:05.975360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de28db4-1812-435f-b086-338c2e2638c8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:05.984675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 828/1632] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:05 2022] PUT /identity/v3/projects/c3724bf1454840eba3f2a19e0d2dc5cf/users/dac2a5bcb14c4895a92de1835337c984/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:05.987675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280eba-8377-42d8-bf28-29c9e24286d5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.987675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280eba-8377-42d8-bf28-29c9e24286d5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.987675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280eba-8377-42d8-bf28-29c9e24286d5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:05.989016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 829/1633] 10.222.0.17 () {54 vars in 912 bytes} [Wed Sep 7 14:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:05.994883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469f189-2348-4cb9-85d3-865f5153634b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:05.995830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469f189-2348-4cb9-85d3-865f5153634b service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:05.997318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280eba-8377-42d8-bf28-29c9e24286d5 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:05.997589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469f189-2348-4cb9-85d3-865f5153634b service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:05.998220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469f189-2348-4cb9-85d3-865f5153634b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.019555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469f189-2348-4cb9-85d3-865f5153634b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:06.025427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469f189-2348-4cb9-85d3-865f5153634b service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:06.034069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 805/1634] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:06.036035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce46db-6cab-4111-a31a-899f86af59ca None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.036514 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce46db-6cab-4111-a31a-899f86af59ca None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.036893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce46db-6cab-4111-a31a-899f86af59ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.060073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-62ce46db-6cab-4111-a31a-899f86af59ca None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:06.061939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-62ce46db-6cab-4111-a31a-899f86af59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:06.078793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280eba-8377-42d8-bf28-29c9e24286d5 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:06.085573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:06.085854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.086206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.086592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.087313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:06.089317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:06.103683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 830/1635] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:06.107423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:06.119989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d007-5b92-452d-918f-90015a8d19a0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:06.136017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:06.137379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.137771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.141749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] PATH_INFO: `/v3/projects/c3724bf1454840eba3f2a19e0d2dc5cf/users/dac2a5bcb14c4895a92de1835337c984/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.152057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3724bf1454840eba3f2a19e0d2dc5cf, user_id=dac2a5bcb14c4895a92de1835337c984, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:06.180454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:06.183243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 806/1636] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:06.184525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3c83-7d7f-4b64-af72-059b78e1884d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.184820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3c83-7d7f-4b64-af72-059b78e1884d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.185102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3c83-7d7f-4b64-af72-059b78e1884d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.186513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 807/1637] 10.222.0.17 () {54 vars in 912 bytes} [Wed Sep 7 14:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:06.194992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211da9f-c0e7-4a17-8f41-b6abd23b15e9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.195351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211da9f-c0e7-4a17-8f41-b6abd23b15e9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.199363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211da9f-c0e7-4a17-8f41-b6abd23b15e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.213097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 831/1638] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:06 2022] PUT /identity/v3/projects/c3724bf1454840eba3f2a19e0d2dc5cf/users/dac2a5bcb14c4895a92de1835337c984/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:06.223269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:06.235757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5211da9f-c0e7-4a17-8f41-b6abd23b15e9 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:06.239322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5211da9f-c0e7-4a17-8f41-b6abd23b15e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:06.261236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:06.348099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1075d-4521-44f7-9a3a-7c0c52ad33e4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:06.350168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 808/1639] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:06.356557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:06.356879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.357160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.358116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.358245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.358430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.358986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.377175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:06.379653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:06.403092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 832/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:06.404796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:06.409793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] MFA Rules not processed for user `dac2a5bcb14c4895a92de1835337c984`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:06.412497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:06.415468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:06.430529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741e86-253c-4015-acbf-9b78fcb339d6 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:06.439596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:06.440216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.440497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.440770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.517835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 809/1641] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:06.567273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:06.567273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:06.737962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 833/1642] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:06.744092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:06.744092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640320f-a3c3-454f-b2da-3c8cfe439f40 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:06.744092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:06.744092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:06.746267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:06.746267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:06.746267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:06.746267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:06.746267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 810/1643] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:07.187016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:07.197332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957f38f-d7df-4b40-a1ac-95e13fcd425a service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:07.201430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79704fe4-9fbf-42e3-9907-f9f87edbe772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:07.202048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704fe4-9fbf-42e3-9907-f9f87edbe772 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:07.202333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704fe4-9fbf-42e3-9907-f9f87edbe772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:07.202879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704fe4-9fbf-42e3-9907-f9f87edbe772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:07.277090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704fe4-9fbf-42e3-9907-f9f87edbe772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:07.278646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704fe4-9fbf-42e3-9907-f9f87edbe772 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:07.290896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 834/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:07.811133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:07.966320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeba53-1f33-4147-87c2-c8f63c8fac25 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:07.983503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:07.984405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:07.985010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:07.985463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] PATH_INFO: `/v3/users/4166ed1a661943dc90ab68cf8c386f35` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:07.987063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4166ed1a661943dc90ab68cf8c386f35)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:07.992483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:08.054204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:08.254478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4166ed1a661943dc90ab68cf8c386f35'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:08.256351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4166ed1a661943dc90ab68cf8c386f35'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:08.268475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4166ed1a661943dc90ab68cf8c386f35'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:08.329349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4166ed1a661943dc90ab68cf8c386f35'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:08.330173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4166ed1a661943dc90ab68cf8c386f35'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:08.453302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 811/1645] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:07 2022] DELETE /identity/v3/users/4166ed1a661943dc90ab68cf8c386f35 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:08.458677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:08.459165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:08.462590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:08.501790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:08.503046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:08.632672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 835/1646] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:08.724537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:08.726044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:08.802920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f9c1-187c-4673-8cd7-98f73ff07351 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:08.807763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49051a-7aea-4cc5-b5cd-3cad30b5f02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:08.809245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49051a-7aea-4cc5-b5cd-3cad30b5f02f service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:08.809632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49051a-7aea-4cc5-b5cd-3cad30b5f02f service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:08.810069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49051a-7aea-4cc5-b5cd-3cad30b5f02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:08.836343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49051a-7aea-4cc5-b5cd-3cad30b5f02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:08.840303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49051a-7aea-4cc5-b5cd-3cad30b5f02f service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:08.872159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 812/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:09.811969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:09.814258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:09.837264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810b5e3-eb2d-4fea-94ca-31e38a4f43ca None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:09.856099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:09.856894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:09.857636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:09.857992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] PATH_INFO: `/v3/projects/93d0d6d7c537400fbc8c3216325b6bbb` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:09.860717 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d0d6d7c537400fbc8c3216325b6bbb)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:09.863583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:09.995614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:10.020135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d0d6d7c537400fbc8c3216325b6bbb', 'request_id': 'req-3517e753-8883-455e-8ca4-1d36249dba0f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:10.170429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d0d6d7c537400fbc8c3216325b6bbb', 'request_id': 'req-3517e753-8883-455e-8ca4-1d36249dba0f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:10.192446 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d0d6d7c537400fbc8c3216325b6bbb', 'request_id': 'req-3517e753-8883-455e-8ca4-1d36249dba0f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:10.231894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] The token cache is being invalidate because project 93d0d6d7c537400fbc8c3216325b6bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:10.232980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:10.236052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3517e753-8883-455e-8ca4-1d36249dba0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:10.240580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 836/1648] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:09 2022] DELETE /identity/v3/projects/93d0d6d7c537400fbc8c3216325b6bbb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:10.245690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:10.247311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:10.247823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:10.324755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:10.326476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:10.524791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 813/1649] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:10.525155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:10.525264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:10.526163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:10.579982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:10.581228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:10.613351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 837/1650] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:10.614885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:10.634818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87261-d27a-4a70-9ac7-1b31681f586d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:10.642723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:10.643696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:10.643998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:10.644903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:10.645737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:10.645960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:10.654190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:10.690060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:10.708762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4381-dd73-48af-9241-eaf49adb5e5f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:10.709356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 814/1651] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:10.728645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:10.729405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:10.729598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:10.729876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:10.730576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:10.739768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:10.863562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 838/1652] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:10 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:10.868673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:10.886390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ff62-949b-47ef-b84d-b13dde8680b2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:11.006983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:11.057743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:11.058697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:11.059134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:11.059609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:11.060513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:11.062658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:11.518492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 815/1653] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:10 2022] POST /identity/v3/users => generated 294 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:11.519188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:11.535558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf334a4-61b5-43c3-be46-3591dd097100 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:11.547895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:11.547895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:11.547895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:11.547895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:11.548236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:11.550075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:11.583551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 839/1654] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:11.586702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:11.598853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6be657-90bd-4600-a71f-20b8bb118f54 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:11.608750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda5e0-2cb4-4680-b948-b4307d9776dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:11.610209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda5e0-2cb4-4680-b948-b4307d9776dd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:11.610728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda5e0-2cb4-4680-b948-b4307d9776dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:11.611215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda5e0-2cb4-4680-b948-b4307d9776dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:11.614773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda5e0-2cb4-4680-b948-b4307d9776dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:11.617076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda5e0-2cb4-4680-b948-b4307d9776dd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:11.634274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 816/1655] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:47:11.639687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:11.662497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e222511-2887-41a1-aef3-47e7558c3fce admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:11.676240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:11.676240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:11.676566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:11.676762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] PATH_INFO: `/v3/projects/777307796d0f47b688e33bbade812042/users/88bdbfdb6ff543fbb95c752f63204d60/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:11.702905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=777307796d0f47b688e33bbade812042, user_id=88bdbfdb6ff543fbb95c752f63204d60, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:11.706390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:11.798386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 840/1656] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:11 2022] PUT /identity/v3/projects/777307796d0f47b688e33bbade812042/users/88bdbfdb6ff543fbb95c752f63204d60/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:11.808989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:11.809270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:11.809714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:11.883730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] MFA Rules not processed for user `88bdbfdb6ff543fbb95c752f63204d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:11.883730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:11.943842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:11.945922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:12.059354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 817/1657] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:12.063425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:12.126675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cd8e6-6730-4b85-aa6f-8d96eb4d68bd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:12.158016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:12.161334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:12.161621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:12.161920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:12.166610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:12.179352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07de4d9-af18-47c4-9409-dd1b633e438d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:12.193578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:12.210754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:12.211022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:12.211302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:12.220476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:12.224167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:12.334068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:12.335999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:12.352859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 818/1658] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:12 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:12.354275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:12.360064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 841/1659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:47:12.488376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf5c3-168a-4c98-aa6d-74ab02a29169 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:12.507442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:12.508088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:12.508378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:12.508665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:12.512855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:12.523799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:12.662211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 819/1660] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:12 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:12.666266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:12.688349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593e9af-400d-4146-945e-edc9d8781890 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:12.716031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:12.716031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:12.716031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:12.716031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:12.723206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:12.726902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:12.733278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:12.759432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 842/1661] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:47:12.759707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:12.793755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b62ad-4321-40d7-b294-64a909ee975f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:12.820800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2ca13-a1f3-4121-89f1-e40a36470416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:12.821579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2ca13-a1f3-4121-89f1-e40a36470416 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:12.822205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2ca13-a1f3-4121-89f1-e40a36470416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:12.822653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2ca13-a1f3-4121-89f1-e40a36470416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:12.824140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2ca13-a1f3-4121-89f1-e40a36470416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:12.825775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2ca13-a1f3-4121-89f1-e40a36470416 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:12.871959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 820/1662] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:47:12.876023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:12.904479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9537a5-7fa8-43ff-b9c6-52819f63c941 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:12.929647 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:12.937501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:12.938563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:12.941938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] PATH_INFO: `/v3/projects/f822e508ea124d39a9988aa42e4e2908/users/4fc4ff3b4b16478f8a7142f008f398e1/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:13.006540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f822e508ea124d39a9988aa42e4e2908, user_id=4fc4ff3b4b16478f8a7142f008f398e1, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:13.011767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:13.021282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:13.137358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 843/1663] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:12 2022] PUT /identity/v3/projects/f822e508ea124d39a9988aa42e4e2908/users/4fc4ff3b4b16478f8a7142f008f398e1/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:13.152204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:13.152204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:13.152204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:13.244991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] MFA Rules not processed for user `4fc4ff3b4b16478f8a7142f008f398e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:13.246260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:13.519496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 821/1664] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:13.524642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:13.711067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7b28-0794-4efa-8e73-b630e7d480e8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:13.717798 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:13.718553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:13.718971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:13.719348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:13.720157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:13.726398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:13.860816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 844/1665] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:13 2022] POST /identity/v3/projects => generated 385 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:13.861578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:13.879756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4c130-e59c-4250-a7be-34f8bdeeb059 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:13.984735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:13.985659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:13.986160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:13.988622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:13.990251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:13.993637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:14.114652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 822/1666] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:13 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:14.118856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:14.137475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d23cf-b53f-4f28-81f3-a85f75eb02f3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:14.147808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:14.148436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:14.148715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:14.149024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:14.149719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:14.151411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:14.184376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 845/1667] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:14.189448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:14.214049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01218e-7af9-4856-ae42-25250a8d05af admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:14.234337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:14.238410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:14.241966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:14.242315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] PATH_INFO: `/v3/projects/df8f90eb33564caba2a9f7abfc6c6415/users/59a0114d3c9d4c57acbb9da23867c957/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:14.297594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8f90eb33564caba2a9f7abfc6c6415, user_id=59a0114d3c9d4c57acbb9da23867c957, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:14.305563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:14.426197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:14.437910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 823/1668] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:14 2022] PUT /identity/v3/projects/df8f90eb33564caba2a9f7abfc6c6415/users/59a0114d3c9d4c57acbb9da23867c957/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:14.438671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:14.461930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74d6b-7729-40d6-81ea-1294fe2741ee admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:14.656817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cbc08-6f0a-459e-a425-c256281eacc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:14.657769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cbc08-6f0a-459e-a425-c256281eacc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:14.660087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cbc08-6f0a-459e-a425-c256281eacc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:14.660908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cbc08-6f0a-459e-a425-c256281eacc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:14.665468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cbc08-6f0a-459e-a425-c256281eacc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:14.669289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cbc08-6f0a-459e-a425-c256281eacc2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:14.684138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 846/1669] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:14.689198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:14.726593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a05b1c-17c1-457b-8dfe-6cbfe1527705 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:14.734302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:14.735064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:14.735722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:14.739843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] PATH_INFO: `/v3/projects/df8f90eb33564caba2a9f7abfc6c6415/users/59a0114d3c9d4c57acbb9da23867c957/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:14.744995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8f90eb33564caba2a9f7abfc6c6415, user_id=59a0114d3c9d4c57acbb9da23867c957, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:14.751578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:14.784751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 824/1670] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:14 2022] PUT /identity/v3/projects/df8f90eb33564caba2a9f7abfc6c6415/users/59a0114d3c9d4c57acbb9da23867c957/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:14.796063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:14.796654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:14.803173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:14.865264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] MFA Rules not processed for user `59a0114d3c9d4c57acbb9da23867c957`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:14.866697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:14.951206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:15.124508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 847/1671] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:15.149255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:15.151268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:15.323133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6955b4-f0e1-48ec-929f-10e096d784a2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:15.334463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51686cff-04ef-4984-b06d-a16b5d3ad946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:15.336633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686cff-04ef-4984-b06d-a16b5d3ad946 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:15.337407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686cff-04ef-4984-b06d-a16b5d3ad946 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:15.338901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51686cff-04ef-4984-b06d-a16b5d3ad946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:15.368986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51686cff-04ef-4984-b06d-a16b5d3ad946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:15.372433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51686cff-04ef-4984-b06d-a16b5d3ad946 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:15.407053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 825/1672] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:16.529596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:16.540823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:16.694042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd09073-4096-4410-ae2f-50866113e860 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:16.694611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:16.695337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:16.696280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:16.696828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] PATH_INFO: `/v3/users/7a942ca036c1425795d7627589472a75` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:16.698795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a942ca036c1425795d7627589472a75)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:16.702768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: WARNING py.warnings [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:47:16.702768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: warnings.warn(msg) Sep 07 14:47:16.702768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: Sep 07 14:47:16.704163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:17.005009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a942ca036c1425795d7627589472a75'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:17.074272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a942ca036c1425795d7627589472a75'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:17.123092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a942ca036c1425795d7627589472a75'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:17.140448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a942ca036c1425795d7627589472a75'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:17.144265 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a942ca036c1425795d7627589472a75'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:17.157542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 848/1673] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:16 2022] DELETE /identity/v3/users/7a942ca036c1425795d7627589472a75 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:17.161996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:17.168462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:17.168462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:17.216403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:17.220855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:17.444396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 826/1674] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:17.482566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:17.484827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:17.609429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:17.614871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:17.625215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:17.639023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da323-83a0-44a3-8209-eb002530139e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:17.648331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:17.648970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:17.651068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:17.651328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:17.676016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:17.678186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:17.700268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 849/1675] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:17.738950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc6055-ef82-482e-82b7-d5c47d6a1ebe None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:17.744792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:17.745484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:17.745822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:17.746111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:17.748967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:17.810624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:17.851874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:17.861893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba93ae7-bf15-4b14-b3d2-7959092ba2d0 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:17.908365 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 827/1676] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:18.144668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:18.146206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:18.170524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d749-c825-4acb-8643-d61a46c24b44 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:18.184224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:18.184965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:18.185255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:18.185533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] PATH_INFO: `/v3/users/75e9f1afe1c34c40a5786b9cf1ea921a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:18.186955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e9f1afe1c34c40a5786b9cf1ea921a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:18.189133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:18.501469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e9f1afe1c34c40a5786b9cf1ea921a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:18.610054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e9f1afe1c34c40a5786b9cf1ea921a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:18.634838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e9f1afe1c34c40a5786b9cf1ea921a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:18.654345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e9f1afe1c34c40a5786b9cf1ea921a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:18.655158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e9f1afe1c34c40a5786b9cf1ea921a'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:18.664926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 850/1677] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:18 2022] DELETE /identity/v3/users/75e9f1afe1c34c40a5786b9cf1ea921a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:18.669376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2e2b-c779-4ef6-ab69-fc938d97e97d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:18.669830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2e2b-c779-4ef6-ab69-fc938d97e97d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:18.669936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2e2b-c779-4ef6-ab69-fc938d97e97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:18.700156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-03fa2e2b-c779-4ef6-ab69-fc938d97e97d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:18.701781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-03fa2e2b-c779-4ef6-ab69-fc938d97e97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:18.797166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 828/1678] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:18.884878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:18.896926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:19.014691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f2ca-1bd2-46fe-843c-353c7d47a2f0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:19.014980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f2ca-1bd2-46fe-843c-353c7d47a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:19.015500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f2ca-1bd2-46fe-843c-353c7d47a2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:19.122694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2a84f2ca-1bd2-46fe-843c-353c7d47a2f0 None None] MFA Rules not processed for user `043a6435674346aaa31dd842f8e12f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:19.125773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f4f6-61b0-4c39-aee8-846335a21a96 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:19.127393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2a84f2ca-1bd2-46fe-843c-353c7d47a2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:19.139430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:19.144728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:19.144728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:19.144728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:19.177212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:19.182587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:19.221203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 851/1679] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:19.326218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 829/1680] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:19.341091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:19.342888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:19.561427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee32f7-8007-4bf4-9788-4d083e34a6d9 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:19.583000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae48ec-d653-4ade-9ab3-f8ee64588bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:19.584254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae48ec-d653-4ade-9ab3-f8ee64588bb9 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:19.584616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae48ec-d653-4ade-9ab3-f8ee64588bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:19.585006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae48ec-d653-4ade-9ab3-f8ee64588bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:19.604354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae48ec-d653-4ade-9ab3-f8ee64588bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:19.609464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae48ec-d653-4ade-9ab3-f8ee64588bb9 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:19.631244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 852/1681] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:19.822214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:19.823187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:19.824268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:19.890529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] MFA Rules not processed for user `4fd98abc30e940728d3810a4369b6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:19.892402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:19.965584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:20.022516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 830/1682] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:20.034652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.035252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.035754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.071126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] MFA Rules not processed for user `4fd98abc30e940728d3810a4369b6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:20.073279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:20.078278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:20.080205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:20.094055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:20.109476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942a413-ab79-49bb-9ac6-8ce1a0dcb081 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:20.113643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 853/1683] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:20.124457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:20.130027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:20.130153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:20.130153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.130153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.131677 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] PATH_INFO: `/v3/projects/435ade9a652147b89b8f6f3087041313` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.136844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435ade9a652147b89b8f6f3087041313)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:20.138834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: WARNING py.warnings [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 14:47:20.138834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: warnings.warn(msg) Sep 07 14:47:20.138834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: Sep 07 14:47:20.150587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:20.176375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3873dd-9d3d-477f-965c-73386ea2c6a3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:20.204842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395d596-2bd8-47c5-90f0-c9cc027e532f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:20.204842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d596-2bd8-47c5-90f0-c9cc027e532f service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.204842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d596-2bd8-47c5-90f0-c9cc027e532f service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.204842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d596-2bd8-47c5-90f0-c9cc027e532f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.226392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395d596-2bd8-47c5-90f0-c9cc027e532f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:20.229451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395d596-2bd8-47c5-90f0-c9cc027e532f service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:20.251458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 854/1684] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:20.406237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435ade9a652147b89b8f6f3087041313', 'request_id': 'req-a70a15bf-3000-4aaf-b9c9-8c767c712223'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:20.450754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435ade9a652147b89b8f6f3087041313', 'request_id': 'req-a70a15bf-3000-4aaf-b9c9-8c767c712223'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:20.464538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435ade9a652147b89b8f6f3087041313', 'request_id': 'req-a70a15bf-3000-4aaf-b9c9-8c767c712223'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:20.563870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] The token cache is being invalidate because project 435ade9a652147b89b8f6f3087041313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:20.568293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:20.568293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a70a15bf-3000-4aaf-b9c9-8c767c712223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:20.568293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 831/1685] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:20 2022] DELETE /identity/v3/projects/435ade9a652147b89b8f6f3087041313 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:20.572247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.572690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.573064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.626132 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:20.627546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:20.707783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 855/1686] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:20.716034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.716435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.716840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.751291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:20.751291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:20.760781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 832/1687] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:20.764806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:20.778746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520651f-1da9-4719-83b1-c5335a0c1274 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:20.786360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:20.787450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.787911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.788372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.789331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:20.790045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:20.792156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:20.808014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 856/1688] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:20.812550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:20.832843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c6524-86a8-4ceb-8e89-650e1403689d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:20.847417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:20.848117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:20.848403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:20.848679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:20.851315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:20.853448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:21.041188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 833/1689] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:20 2022] POST /identity/v3/projects => generated 403 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:47:21.042514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:21.060672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d062c3-aefc-4144-aba8-bf3c23236153 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:21.272467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427669c-d17f-4e83-a7e9-5120c03d5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:21.273501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427669c-d17f-4e83-a7e9-5120c03d5c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.273950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427669c-d17f-4e83-a7e9-5120c03d5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.274997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427669c-d17f-4e83-a7e9-5120c03d5c68 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.278045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427669c-d17f-4e83-a7e9-5120c03d5c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:21.280765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427669c-d17f-4e83-a7e9-5120c03d5c68 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:21.427546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 857/1690] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:21 2022] POST /identity/v3/users => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:21.428319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:21.445230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.447638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.448106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.448425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc539380-240b-4de7-92c9-ccb9b7779fde admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:21.463748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:21.465172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.465470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.470324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.472431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:21.500708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:21.548471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 834/1691] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:21.557152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:21.567436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] MFA Rules not processed for user `7207cf1f839b471bb0bff5648534cfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:21.568884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:21.598539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ecf6f-2ff2-4805-b90c-bc59d5cff24a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:21.626881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:21.626881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.626881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.626881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.630079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:21.633471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:21.670699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 835/1692] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:21.675680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:21.700517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca8b9-bef5-4b2c-a40d-b19f9917857f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:21.714481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b47e49-abbf-460b-bc6f-837d09e670b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:21.715441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b47e49-abbf-460b-bc6f-837d09e670b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.715536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b47e49-abbf-460b-bc6f-837d09e670b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.715806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b47e49-abbf-460b-bc6f-837d09e670b2 admin admin] PATH_INFO: `/v3/projects/67212cd8665d4056bac62b460a26f7a6/users/0549737a4b634b06b571fbb891140cb6/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.760307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b47e49-abbf-460b-bc6f-837d09e670b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67212cd8665d4056bac62b460a26f7a6, user_id=0549737a4b634b06b571fbb891140cb6, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:21.765809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b47e49-abbf-460b-bc6f-837d09e670b2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:21.773010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 858/1693] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:21.787247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:21.796015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:21.891269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 836/1694] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:21 2022] PUT /identity/v3/projects/67212cd8665d4056bac62b460a26f7a6/users/0549737a4b634b06b571fbb891140cb6/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:21.892848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f92b3-be0d-4831-b63b-951afb2de130 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.893140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f92b3-be0d-4831-b63b-951afb2de130 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.893422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f92b3-be0d-4831-b63b-951afb2de130 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.901084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 837/1695] 10.222.0.17 () {54 vars in 912 bytes} [Wed Sep 7 14:47:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:21.904279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31a34-7c3f-4a44-abf5-3e5719bda8d1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:21.904676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31a34-7c3f-4a44-abf5-3e5719bda8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:21.908344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31a34-7c3f-4a44-abf5-3e5719bda8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:21.986877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-eed31a34-7c3f-4a44-abf5-3e5719bda8d1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:21.991725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-eed31a34-7c3f-4a44-abf5-3e5719bda8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:22.008189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad70ae-ce65-4da7-873b-762f7f6792a4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:22.157552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 838/1696] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:22.159971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:22.160290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:22.168423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:22.191042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:22.191837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:22.192266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:22.192673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:22.203028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:22.227049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:22.259220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:22.262783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:22.349409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:22.351334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:22.365109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 859/1697] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:22.366252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:22.367666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:22.384966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c42c-6c29-4ea2-8de3-1134cd1e64f7 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:22.391864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 839/1698] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:22.395769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:22.396978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:22.397969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:22.398322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:22.398738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] PATH_INFO: `/v3/projects/aa9bdf9f911e43a696471cb277f1c902` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:22.399246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:22.402112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9bdf9f911e43a696471cb277f1c902)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:22.408680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:22.421457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62062bba-e40b-4450-8571-9d62a891e156 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:22.439427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25ee3-f55b-4f37-a038-5459a1e65162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:22.441256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25ee3-f55b-4f37-a038-5459a1e65162 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:22.441701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25ee3-f55b-4f37-a038-5459a1e65162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:22.441987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25ee3-f55b-4f37-a038-5459a1e65162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:22.469064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25ee3-f55b-4f37-a038-5459a1e65162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:22.474157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25ee3-f55b-4f37-a038-5459a1e65162 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:22.496469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 840/1699] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:22.497890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:22.498185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:22.499407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:22.584630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] MFA Rules not processed for user `5e048d74b095442f97f26d57f823123f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:22.586395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:22.646615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9bdf9f911e43a696471cb277f1c902', 'request_id': 'req-b59c5ef9-2286-46b4-98bd-f3e0b7778952'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:22.763257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9bdf9f911e43a696471cb277f1c902', 'request_id': 'req-b59c5ef9-2286-46b4-98bd-f3e0b7778952'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:22.770719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9bdf9f911e43a696471cb277f1c902', 'request_id': 'req-b59c5ef9-2286-46b4-98bd-f3e0b7778952'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:22.794973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 841/1700] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:22.797393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] The token cache is being invalidate because project aa9bdf9f911e43a696471cb277f1c902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:22.797876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:22.799249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b59c5ef9-2286-46b4-98bd-f3e0b7778952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:22.801360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 860/1701] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:22 2022] DELETE /identity/v3/projects/aa9bdf9f911e43a696471cb277f1c902 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:22.805903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:22.808640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:22.808640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:22.811314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:22.851706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afb09-e54c-47a0-b4d6-b5be38dfd3b7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:22.877065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] MFA Rules not processed for user `5e048d74b095442f97f26d57f823123f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:22.881342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:23.009861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:23.010668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:23.011056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:23.011824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:23.019925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:23.029935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 861/1702] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:23.029935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:23.029935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:23.049254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:23.051400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:23.086739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 842/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:23.087816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:23.095027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:23.195998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ea438-6156-42e5-b60a-235dd2c2d23b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:23.208917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:23.209723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:23.210794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:23.212049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] PATH_INFO: `/v3/users/168304edec4848d3b8ca12dfb90ac000` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:23.214539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168304edec4848d3b8ca12dfb90ac000)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:23.219792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:23.334299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aad9b-aa7d-4a0c-af2a-318c382a086b service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:23.354882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:23.355794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:23.356359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:23.358203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:23.363828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:23.380679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:23.383780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bb379-74d5-4b64-a212-dd14d3bb3672 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:23.412287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 843/1704] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:23.542755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168304edec4848d3b8ca12dfb90ac000'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:23.632289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168304edec4848d3b8ca12dfb90ac000'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:23.695072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168304edec4848d3b8ca12dfb90ac000'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:23.719829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168304edec4848d3b8ca12dfb90ac000'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:23.721118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1cf97be9-be3b-46d1-87f7-54a9ec60e983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168304edec4848d3b8ca12dfb90ac000'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:23.736634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 862/1705] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:23 2022] DELETE /identity/v3/users/168304edec4848d3b8ca12dfb90ac000 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:24.306124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:24.337929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25ff09-02de-496a-a289-29471254371e None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:24.338477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25ff09-02de-496a-a289-29471254371e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:24.338719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25ff09-02de-496a-a289-29471254371e None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:24.340136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 844/1706] 10.222.0.17 () {54 vars in 912 bytes} [Wed Sep 7 14:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:24.348290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:24.349115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:24.349549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:24.417242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25ff09-02de-496a-a289-29471254371e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:24.427816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0f25ff09-02de-496a-a289-29471254371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.434219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:24.440510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.640067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25ff09-02de-496a-a289-29471254371e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:24.643184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 863/1707] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:24.644649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:24.647031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:24.647991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:24.648414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:24.648864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:24.656256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.662871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.670931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:24.675553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67978afa-6f0a-41be-b971-9758e3e7a096 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:24.704911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 845/1708] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:24.710680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:24.711174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:24.711660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:24.770283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] MFA Rules not processed for user `4fd98abc30e940728d3810a4369b6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:24.773569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.803200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfdd2f-10dc-4c1c-ba0c-6b675db59917 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:24.809800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:24.816334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:24.816334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:24.816334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:24.816334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.950855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 846/1709] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:24.952704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:24.970293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:24.997618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa969fd4-9f91-42bf-a6e8-84b4d35aa9de None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:25.004759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75052e70-a904-4d52-9e68-b3e1fcf1656b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:25.005961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75052e70-a904-4d52-9e68-b3e1fcf1656b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:25.007031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75052e70-a904-4d52-9e68-b3e1fcf1656b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:25.007491 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75052e70-a904-4d52-9e68-b3e1fcf1656b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:25.038116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:25.040134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:25.062022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75052e70-a904-4d52-9e68-b3e1fcf1656b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:25.066260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75052e70-a904-4d52-9e68-b3e1fcf1656b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:25.076236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 864/1710] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:25.111128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 847/1711] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:25.152645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:25.155573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:25.248776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:25.306207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:25.337404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d5182-10c6-40d7-b5be-8aeff5811af4 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:25.355025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:25.355025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:25.355025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:25.355025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] PATH_INFO: `/v3/projects/ba80b4b105e44147934a7cf28cfacb59` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:25.355523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba80b4b105e44147934a7cf28cfacb59)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:25.355523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:25.535158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba80b4b105e44147934a7cf28cfacb59', 'request_id': 'req-c9ca93e7-8434-4b5d-b154-44e3031c4dec'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:25.627637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba80b4b105e44147934a7cf28cfacb59', 'request_id': 'req-c9ca93e7-8434-4b5d-b154-44e3031c4dec'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:25.652247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba80b4b105e44147934a7cf28cfacb59', 'request_id': 'req-c9ca93e7-8434-4b5d-b154-44e3031c4dec'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:25.734035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] The token cache is being invalidate because project ba80b4b105e44147934a7cf28cfacb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:25.734035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:25.734035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c9ca93e7-8434-4b5d-b154-44e3031c4dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:25.736374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 865/1712] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:25 2022] DELETE /identity/v3/projects/ba80b4b105e44147934a7cf28cfacb59 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:25.742960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:25.743398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:25.743815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:25.792635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:25.796709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:26.005793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:26.086697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 848/1713] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:26.101625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccbb33-7c27-4ea5-8860-ae120bf8a92d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:26.106083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccbb33-7c27-4ea5-8860-ae120bf8a92d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:26.106083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccbb33-7c27-4ea5-8860-ae120bf8a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:26.193944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3dccbb33-7c27-4ea5-8860-ae120bf8a92d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:26.197566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3dccbb33-7c27-4ea5-8860-ae120bf8a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:26.232629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 866/1714] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:26.239116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:26.257710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3939c-afa2-4565-881e-8676f23a0110 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:26.261288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:26.266372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:26.266372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:26.281285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:26.284857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:26.285374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:26.285962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:26.288181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:26.294110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:26.295770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:26.406165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 849/1715] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:26.407651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:26.435134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] MFA Rules not processed for user `0549737a4b634b06b571fbb891140cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:26.444254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:26.473278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07bd0-e1e2-40a7-ad37-94586cc0cabd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:26.495174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:26.496834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:26.500077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:26.503025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:26.503025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:26.511352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:26.725562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 850/1716] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:26 2022] POST /identity/v3/projects => generated 381 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:26.727613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:26.761642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 867/1717] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:26.762638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:26.768014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:26.814155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c1d62-7f8b-4905-b125-7f102c3f1f35 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:26.932028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d60a3c-dc81-41dd-a969-710e4aef55ca admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:26.943249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527c1f-a018-4e3a-9f6d-b59b0f1319b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:26.944198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527c1f-a018-4e3a-9f6d-b59b0f1319b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:26.944968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527c1f-a018-4e3a-9f6d-b59b0f1319b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:26.945428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527c1f-a018-4e3a-9f6d-b59b0f1319b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:26.946508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527c1f-a018-4e3a-9f6d-b59b0f1319b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:26.949059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527c1f-a018-4e3a-9f6d-b59b0f1319b3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:26.954854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:26.956750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:26.958716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:26.960143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:26.961916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:26.972153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.111925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 851/1718] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:26 2022] POST /identity/v3/users => generated 291 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:27.113408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.113697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.114076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.123298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 868/1719] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:26 2022] POST /identity/v3/projects => generated 403 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:27.129090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:27.193057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] MFA Rules not processed for user `043a6435674346aaa31dd842f8e12f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:27.194362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:27.352438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b50a0-0ccd-4031-adee-f25c38e8c0de admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:27.370499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:27.371142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.371514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.371796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.372575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:27.374128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.401164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 852/1720] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:27.402203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:27.432575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 869/1721] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:27.434536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:27.438851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913a29-db67-4e2a-9a58-34eeb52ca6c0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:27.463031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:27.463680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.463967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.464237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.464895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:27.466830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.472171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76460-457d-47b9-92d4-a8b0a40f74d6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:27.490251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:27.490251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.490251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.490251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.490824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:27.494803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.539199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 870/1722] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:27.554432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:27.605907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 853/1723] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:27 2022] POST /identity/v3/users => generated 308 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:27.612652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:27.615551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912615cc-e8e6-40ca-954e-e05547f0767d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:27.634751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02bcbc-41e3-4b3d-a355-8239c21aea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:27.635477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02bcbc-41e3-4b3d-a355-8239c21aea18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.636361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02bcbc-41e3-4b3d-a355-8239c21aea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.636737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02bcbc-41e3-4b3d-a355-8239c21aea18 admin admin] PATH_INFO: `/v3/projects/6c18953854e541daaec3d1480b3e8efc/users/b941049963474fa8bfec3869896eab1b/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.664033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83879acb-1031-408c-8503-16121d1c5a40 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:27.677007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02bcbc-41e3-4b3d-a355-8239c21aea18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c18953854e541daaec3d1480b3e8efc, user_id=b941049963474fa8bfec3869896eab1b, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:27.680130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02bcbc-41e3-4b3d-a355-8239c21aea18 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.694467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:27.696129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.698669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.699193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.700335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:27.705135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.736003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 854/1724] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:27.740645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:27.748805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:27.768148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0ff2-1267-41b7-aeed-926828f14e82 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:27.799296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:27.800304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.801874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.803013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] PATH_INFO: `/v3/projects/2174feedeca64c09abd86a32a913b2b0/users/856bafd2003f403c8343cc893a01edc5/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.832164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 871/1725] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:27 2022] PUT /identity/v3/projects/6c18953854e541daaec3d1480b3e8efc/users/b941049963474fa8bfec3869896eab1b/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:27.844058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:27.844834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:27.845127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:27.849939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2174feedeca64c09abd86a32a913b2b0, user_id=856bafd2003f403c8343cc893a01edc5, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:27.854828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:27.871970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:27.932593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] MFA Rules not processed for user `b941049963474fa8bfec3869896eab1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:27.934235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:28.135857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 855/1726] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:27 2022] PUT /identity/v3/projects/2174feedeca64c09abd86a32a913b2b0/users/856bafd2003f403c8343cc893a01edc5/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:28.139923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:28.187124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 872/1727] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:28.192434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:28.438860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e1336-8704-45b5-992a-5d97966856f0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:28.449721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:28.449721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:28.449721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:28.450342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:28.451149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:28.456924 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218a9e-24ff-4f0c-998a-1ca8be183989 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:28.457735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:28.472093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:28.472784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:28.473324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:28.473411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:28.474214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:28.478148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:28.497710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 856/1728] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:28.502107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:28.566082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae35fd-ef15-48c4-affe-99ef1b666980 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:28.584070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:28.584766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:28.585099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:28.585370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] PATH_INFO: `/v3/projects/2174feedeca64c09abd86a32a913b2b0/users/856bafd2003f403c8343cc893a01edc5/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:28.593314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2174feedeca64c09abd86a32a913b2b0, user_id=856bafd2003f403c8343cc893a01edc5, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:28.593314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:28.630188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 873/1729] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:28 2022] POST /identity/v3/projects => generated 381 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:28.634976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:28.651492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 857/1730] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:28 2022] PUT /identity/v3/projects/2174feedeca64c09abd86a32a913b2b0/users/856bafd2003f403c8343cc893a01edc5/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:28.789642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4029eea-91a7-4d49-9be0-204394166775 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:29.013436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:29.013723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.014008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.023992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:29.044670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:29.044670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:29.226279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 874/1731] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:28 2022] POST /identity/v3/users => generated 297 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:29.230383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:29.243729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639bba1-52bb-4e2f-8fe1-e2e94894b780 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:29.275400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad14f-5e79-4d2b-ae05-0e4c096c59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:29.278143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad14f-5e79-4d2b-ae05-0e4c096c59b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.278441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad14f-5e79-4d2b-ae05-0e4c096c59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.278727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad14f-5e79-4d2b-ae05-0e4c096c59b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:29.283082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad14f-5e79-4d2b-ae05-0e4c096c59b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:29.294319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad14f-5e79-4d2b-ae05-0e4c096c59b9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:29.315694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 858/1732] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:29.319519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:29.346059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d4c27-9dc5-4907-a2f2-b7557ae7c183 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:29.382363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:29.391267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.396545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.396773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] PATH_INFO: `/v3/projects/3faebdbef45d4b3696cbfbc733804309/users/6bf51be87b6042f3906331c2c47f0b49/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:29.474845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3faebdbef45d4b3696cbfbc733804309, user_id=6bf51be87b6042f3906331c2c47f0b49, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:29.496540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:29.513816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1ac3-5a58-4a62-aa7b-d4b136affc44 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.514367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1ac3-5a58-4a62-aa7b-d4b136affc44 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.514799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1ac3-5a58-4a62-aa7b-d4b136affc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:29.586264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-22ed1ac3-5a58-4a62-aa7b-d4b136affc44 None None] MFA Rules not processed for user `7207cf1f839b471bb0bff5648534cfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:29.587547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-22ed1ac3-5a58-4a62-aa7b-d4b136affc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:29.637676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 875/1733] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:29 2022] PUT /identity/v3/projects/3faebdbef45d4b3696cbfbc733804309/users/6bf51be87b6042f3906331c2c47f0b49/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:29.645307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:29.798839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2bcf1-101e-4b32-8932-22397604edbc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:29.806360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:29.807252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.807708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.807990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:29.808999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:29.810622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:29.828426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 876/1734] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:47:29.843142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:29.867611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 859/1735] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:29.876668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eef62-2fa2-48ac-bbf3-c105dcb9c78b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:29.887398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152eb17-8676-498e-bdfd-4d1400f3daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:29.888138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152eb17-8676-498e-bdfd-4d1400f3daa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.888471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152eb17-8676-498e-bdfd-4d1400f3daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.888803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152eb17-8676-498e-bdfd-4d1400f3daa6 admin admin] PATH_INFO: `/v3/projects/3faebdbef45d4b3696cbfbc733804309/users/6bf51be87b6042f3906331c2c47f0b49/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:29.891442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152eb17-8676-498e-bdfd-4d1400f3daa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3faebdbef45d4b3696cbfbc733804309, user_id=6bf51be87b6042f3906331c2c47f0b49, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:29.896024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152eb17-8676-498e-bdfd-4d1400f3daa6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:29.923419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 877/1736] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:29 2022] PUT /identity/v3/projects/3faebdbef45d4b3696cbfbc733804309/users/6bf51be87b6042f3906331c2c47f0b49/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:29.924030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:29.925085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:29.925483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:30.027631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] MFA Rules not processed for user `6bf51be87b6042f3906331c2c47f0b49`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:30.029897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:30.130683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:30.178905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 860/1737] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:31.026968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:31.288549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:31.288838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:31.289190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:31.482377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:31.483678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:31.759018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:31.760500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:31.761531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 878/1738] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:31.831590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:31.833229 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:31.975677 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05509-5545-4cb5-8614-3b90a519b5e1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:31.995453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:31.996434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:31.997833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:31.998339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:32.015916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:32.024948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:32.050589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 861/1739] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:32.054868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:32.057755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:32.124865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c2ce-fe09-4c8f-aba0-d5db7a8a4857 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:32.144697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:32.156353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:32.157800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:32.158266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] PATH_INFO: `/v3/users/88bdbfdb6ff543fbb95c752f63204d60` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:32.160194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bdbfdb6ff543fbb95c752f63204d60)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:32.162584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:32.330794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2cb08-938b-4b26-8781-d0c055697660 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:32.343910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:32.344808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:32.345236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:32.345655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] PATH_INFO: `/v3/users/7826fd64387546a3a4be1f4d04b070c2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:32.348040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7826fd64387546a3a4be1f4d04b070c2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:32.350400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:32.458608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bdbfdb6ff543fbb95c752f63204d60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.578605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bdbfdb6ff543fbb95c752f63204d60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.626143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7826fd64387546a3a4be1f4d04b070c2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.627225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7826fd64387546a3a4be1f4d04b070c2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.630828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bdbfdb6ff543fbb95c752f63204d60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.643366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7826fd64387546a3a4be1f4d04b070c2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.656250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7826fd64387546a3a4be1f4d04b070c2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.660044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2169c38f-fd94-4133-b1cf-0915e4d8523d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7826fd64387546a3a4be1f4d04b070c2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.663746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bdbfdb6ff543fbb95c752f63204d60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.668418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bdbfdb6ff543fbb95c752f63204d60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:32.695038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 879/1740] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:31 2022] DELETE /identity/v3/users/88bdbfdb6ff543fbb95c752f63204d60 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:32.695946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:32.700230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:32.786660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 862/1741] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:32 2022] DELETE /identity/v3/users/7826fd64387546a3a4be1f4d04b070c2 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:32.789644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596675a-f57c-416c-abca-fd65c0665483 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:32.824155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596675a-f57c-416c-abca-fd65c0665483 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:32.824736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596675a-f57c-416c-abca-fd65c0665483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:32.884821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:32.919427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7596675a-f57c-416c-abca-fd65c0665483 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:32.921580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7596675a-f57c-416c-abca-fd65c0665483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:32.970372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3650f-2c84-4597-b43f-c377e47c6f86 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:33.102093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 863/1742] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:33.106695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.107004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.107294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.125594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:33.126236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.126520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.126971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.133372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:33.156012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:33.166451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:33.190818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 864/1743] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:33.199124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:33.204086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:33.287261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:33.289146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d861e0-411b-4e59-94dd-3a2cb073963f service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:33.305854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90613-cda3-404d-865f-d50962a6416d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:33.306878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 880/1744] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:47:33.309555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.310057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.311476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.312566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:33.313185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.313450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.313895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.339827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:33.341079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:33.346369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:33.348845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:33.359647 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 881/1745] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Sep 7 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:33.360742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:33.398196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444d27e-7a5d-42d7-85fe-955bae7fa114 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:33.399496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 865/1746] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:33.400416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:33.427235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:33.429045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.431808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.433493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.450150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7211-747a-473d-abc7-798946163a6e service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:33.465793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:33.466573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.466865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.467197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.469391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:33.480447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:33.490453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:33.497508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:33.503260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 866/1747] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:33.514738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 882/1748] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:33.619134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:33.620802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:33.829679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e83273-cf1f-4e7f-8ab0-64f439bb650b service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:33.839695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf51be87b6042f3906331c2c47f0b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faebdbef45d4b3696cbfbc733804309', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:33.840739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.841193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.841682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.842560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:33.843073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:33.846653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:33.921415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:33.937903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eceb33-9c02-41d7-946d-3e5d67d2bacd service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:33.939010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 867/1749] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:33.953438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf51be87b6042f3906331c2c47f0b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faebdbef45d4b3696cbfbc733804309', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:33.953960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:33.954218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:33.954527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:33.955180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:33.957389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:34.125267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:34.138198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 883/1750] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:33 2022] POST /identity/v3/projects => generated 355 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:34.145621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d0fbf-4efb-45bb-b829-19948281bad6 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:34.389119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf51be87b6042f3906331c2c47f0b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faebdbef45d4b3696cbfbc733804309', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:34.389819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:34.390947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:34.391828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:34.397293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:34.403556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:34.403556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45860115-e6a0-43de-a549-2f2138e369f8 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:34.451493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 868/1751] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:34.548009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:34.569823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb887a1c-0c6d-48c0-82c2-8854ad924bc9 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:34.585932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:34.586532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:34.589813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:34.589923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf51be87b6042f3906331c2c47f0b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faebdbef45d4b3696cbfbc733804309', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:34.589923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:34.590312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:34.592696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] PATH_INFO: `/v3/projects/752a592dd4c641cb804cf25ba0b31805` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:34.606208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorizing `identity:delete_project(project_id=752a592dd4c641cb804cf25ba0b31805)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:34.608414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:34.630059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:34.689804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] MFA Rules not processed for user `856bafd2003f403c8343cc893a01edc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:34.693067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:34.800294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752a592dd4c641cb804cf25ba0b31805', 'request_id': 'req-42868e99-0454-4fc6-959e-ead990196374'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:34.988363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 869/1752] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:35.133939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752a592dd4c641cb804cf25ba0b31805', 'request_id': 'req-42868e99-0454-4fc6-959e-ead990196374'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:35.168598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752a592dd4c641cb804cf25ba0b31805', 'request_id': 'req-42868e99-0454-4fc6-959e-ead990196374'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:35.172860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] The token cache is being invalidate because project 752a592dd4c641cb804cf25ba0b31805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:35.173162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:35.173881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-42868e99-0454-4fc6-959e-ead990196374 tempest-VolumeQuotaClassesTest-1019532437 tempest-VolumeQuotaClassesTest-1019532437-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:35.176515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 884/1753] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:34 2022] DELETE /identity/v3/projects/752a592dd4c641cb804cf25ba0b31805 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:36.306790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:36.312924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:36.493327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecf52f-de22-4b60-937b-fe14a288f8ef None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:36.567255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:36.569023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:36.569516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:36.570544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] PATH_INFO: `/v3/users/b941049963474fa8bfec3869896eab1b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:36.571995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b941049963474fa8bfec3869896eab1b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:36.574103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:36.579718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:36.827289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b941049963474fa8bfec3869896eab1b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:36.827289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b941049963474fa8bfec3869896eab1b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:36.850295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b941049963474fa8bfec3869896eab1b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:36.893842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b941049963474fa8bfec3869896eab1b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:36.896107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b941049963474fa8bfec3869896eab1b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:36.911763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:37.043592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 870/1754] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:36 2022] DELETE /identity/v3/users/b941049963474fa8bfec3869896eab1b => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:37.052095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:37.052472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:37.052760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:37.124426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:37.130009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:37.329368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:37.359449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 885/1755] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:37.425982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:37.427483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:37.571656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2cdd2-1ab5-476c-8db1-669c4c7c06e4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:37.579762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:37.583391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:37.584492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:37.585147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:37.609758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:37.610615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:37.645571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 871/1756] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:38.068854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:38.070815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:38.094630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd58df-68fc-4c3a-b09e-2c0121f7b046 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:38.107559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:38.108555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:38.109023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:38.109890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] PATH_INFO: `/v3/projects/777307796d0f47b688e33bbade812042` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:38.113315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=777307796d0f47b688e33bbade812042)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:38.115774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:38.263856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777307796d0f47b688e33bbade812042', 'request_id': 'req-bf86c02e-c88f-4509-8293-cedbc29a7a0c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.302447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:38.304619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:38.338043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777307796d0f47b688e33bbade812042', 'request_id': 'req-bf86c02e-c88f-4509-8293-cedbc29a7a0c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.341812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26809d8-75bc-49f5-b3bd-c2545e28667a service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:38.349600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777307796d0f47b688e33bbade812042', 'request_id': 'req-bf86c02e-c88f-4509-8293-cedbc29a7a0c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.374636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] The token cache is being invalidate because project 777307796d0f47b688e33bbade812042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:38.375419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.377886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.379801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 886/1757] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:38 2022] DELETE /identity/v3/projects/777307796d0f47b688e33bbade812042 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:38.384988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:38.388763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:38.527576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:38.528750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:38.529309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:38.529797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] PATH_INFO: `/v3/projects/212e4e6fbb3145e8a03b2349f1c3e21d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:38.541433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212e4e6fbb3145e8a03b2349f1c3e21d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:38.545042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:38.564111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:38.584805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86c02e-c88f-4509-8293-cedbc29a7a0c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:38.614475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:38.615830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:38.618755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:38.618755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] PATH_INFO: `/v3/users/4fc4ff3b4b16478f8a7142f008f398e1` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:38.630080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc4ff3b4b16478f8a7142f008f398e1)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:38.632146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:38.633647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:38.876781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212e4e6fbb3145e8a03b2349f1c3e21d', 'request_id': 'req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.883901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc4ff3b4b16478f8a7142f008f398e1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.899897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212e4e6fbb3145e8a03b2349f1c3e21d', 'request_id': 'req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:38.935646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212e4e6fbb3145e8a03b2349f1c3e21d', 'request_id': 'req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.016236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc4ff3b4b16478f8a7142f008f398e1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.054206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc4ff3b4b16478f8a7142f008f398e1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.089942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc4ff3b4b16478f8a7142f008f398e1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.094755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3ba25e47-85b7-4d41-bcfc-8ffcd3ce3f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc4ff3b4b16478f8a7142f008f398e1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.110849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] The token cache is being invalidate because project 212e4e6fbb3145e8a03b2349f1c3e21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:39.111018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.112497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 887/1758] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:38 2022] DELETE /identity/v3/users/4fc4ff3b4b16478f8a7142f008f398e1 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:39.113161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.116028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 872/1759] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:38 2022] DELETE /identity/v3/projects/212e4e6fbb3145e8a03b2349f1c3e21d => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:39.120776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972d4f-11c7-487d-82bd-ef849437a97e None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:39.120776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972d4f-11c7-487d-82bd-ef849437a97e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:39.120776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972d4f-11c7-487d-82bd-ef849437a97e None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:39.120776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 888/1760] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:47:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:39.124137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:39.126370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:39.159348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:39.159691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:39.160018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:39.215408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:39.216903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:39.304332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a93a4-5cb7-41ff-be72-94eafe89b3d3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:39.380841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:39.387534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 889/1761] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:39.426977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:39.430015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:39.459561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0e33e-e166-44c7-ae74-d2ac627fecb6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:39.467497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e167c4-a8f7-4eb6-bef8-14651dc57f65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:39.468619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e167c4-a8f7-4eb6-bef8-14651dc57f65 service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:39.469081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e167c4-a8f7-4eb6-bef8-14651dc57f65 service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:39.469525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e167c4-a8f7-4eb6-bef8-14651dc57f65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:39.472090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:39.474252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:39.474252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:39.474252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] PATH_INFO: `/v3/users/dac2a5bcb14c4895a92de1835337c984` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:39.475302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac2a5bcb14c4895a92de1835337c984)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:39.481536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:39.482730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e167c4-a8f7-4eb6-bef8-14651dc57f65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:39.484885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e167c4-a8f7-4eb6-bef8-14651dc57f65 service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:39.521271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 890/1762] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:47:39.704296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac2a5bcb14c4895a92de1835337c984'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.705002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac2a5bcb14c4895a92de1835337c984'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.731827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac2a5bcb14c4895a92de1835337c984'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.771515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41e17-965e-4daa-a9d6-22fdefceadd5 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:39.771983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41e17-965e-4daa-a9d6-22fdefceadd5 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:39.772681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41e17-965e-4daa-a9d6-22fdefceadd5 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:39.778928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac2a5bcb14c4895a92de1835337c984'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.780629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac2a5bcb14c4895a92de1835337c984'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:39.786504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 891/1763] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:47:39 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:39.825967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696b20-3866-45a4-80c4-6bc361b59c51 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:39.826490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696b20-3866-45a4-80c4-6bc361b59c51 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:39.827245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696b20-3866-45a4-80c4-6bc361b59c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:39.858301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 873/1764] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:39 2022] DELETE /identity/v3/users/dac2a5bcb14c4895a92de1835337c984 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:39.859777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d4696b20-3866-45a4-80c4-6bc361b59c51 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:39.861543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d4696b20-3866-45a4-80c4-6bc361b59c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:40.029603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 892/1765] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:40.030370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:40.506706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:40.634457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:40.644418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:40.686276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c417160-7fa8-48b0-a4af-e2051684aa9a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:40.711893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b040fe-b97b-496d-bb36-933b8b4ae484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:40.714831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b040fe-b97b-496d-bb36-933b8b4ae484 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:40.716457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b040fe-b97b-496d-bb36-933b8b4ae484 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:40.717959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b040fe-b97b-496d-bb36-933b8b4ae484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:40.750229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b040fe-b97b-496d-bb36-933b8b4ae484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:40.789052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b040fe-b97b-496d-bb36-933b8b4ae484 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:40.828926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 874/1766] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:41.285429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c4fb-6009-4e15-81d8-2eabe4c9135d None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:41.289726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c4fb-6009-4e15-81d8-2eabe4c9135d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:41.289726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c4fb-6009-4e15-81d8-2eabe4c9135d None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:41.289726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 893/1767] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:41.330889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:41.331254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:41.331825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:41.360219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:41.361767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:41.378747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 875/1768] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:47:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:41.435469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30c4fb-6009-4e15-81d8-2eabe4c9135d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:41.463791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30c4fb-6009-4e15-81d8-2eabe4c9135d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:41.471223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:41.489519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:41.490633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:41.491596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:41.492087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:41.525845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:41.527983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:41.543115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 894/1769] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:41.770324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:41.772143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:41.933300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b929b94-86e8-409a-9285-e59c7af73bb1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:41.937233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:41.938570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:41.939054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:41.940208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] PATH_INFO: `/v3/projects/6c18953854e541daaec3d1480b3e8efc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:41.956706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c18953854e541daaec3d1480b3e8efc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:41.959911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:42.094118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:42.094118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:42.116392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f074-db1e-43d0-bdaf-48e4d5b93b70 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:42.158944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:42.162156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:42.162576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:42.164839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] PATH_INFO: `/v3/users/0549737a4b634b06b571fbb891140cb6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:42.174448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0549737a4b634b06b571fbb891140cb6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:42.174856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c18953854e541daaec3d1480b3e8efc', 'request_id': 'req-950bbb09-2d20-4d84-968f-2efed11499e7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.177275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:42.205760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c18953854e541daaec3d1480b3e8efc', 'request_id': 'req-950bbb09-2d20-4d84-968f-2efed11499e7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.222797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c18953854e541daaec3d1480b3e8efc', 'request_id': 'req-950bbb09-2d20-4d84-968f-2efed11499e7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.311548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] The token cache is being invalidate because project 6c18953854e541daaec3d1480b3e8efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:42.311893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.312870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.318359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 876/1770] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:41 2022] DELETE /identity/v3/projects/6c18953854e541daaec3d1480b3e8efc => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:42.319317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:42.321021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:42.391970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:42.435336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bbb09-2d20-4d84-968f-2efed11499e7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:42.442277 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:42.443186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:42.445854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:42.445854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] PATH_INFO: `/v3/users/6bf51be87b6042f3906331c2c47f0b49` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:42.445854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf51be87b6042f3906331c2c47f0b49)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:42.447354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:42.484189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0549737a4b634b06b571fbb891140cb6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.578177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0549737a4b634b06b571fbb891140cb6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.608594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0549737a4b634b06b571fbb891140cb6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.626121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0549737a4b634b06b571fbb891140cb6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.629307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0549737a4b634b06b571fbb891140cb6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.655590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 895/1771] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:42 2022] DELETE /identity/v3/users/0549737a4b634b06b571fbb891140cb6 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:42.655590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:42.655590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:42.699827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf51be87b6042f3906331c2c47f0b49'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.700682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf51be87b6042f3906331c2c47f0b49'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.711583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf51be87b6042f3906331c2c47f0b49'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.729232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf51be87b6042f3906331c2c47f0b49'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.730145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf51be87b6042f3906331c2c47f0b49'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:42.809969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51c1b-168d-4386-aa6b-035289acc921 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:42.819287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:42.820183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:42.820640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:42.821161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] PATH_INFO: `/v3/projects/f822e508ea124d39a9988aa42e4e2908` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:42.823133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f822e508ea124d39a9988aa42e4e2908)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:42.825817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:42.848873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 877/1772] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:42 2022] DELETE /identity/v3/users/6bf51be87b6042f3906331c2c47f0b49 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:43.016604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f822e508ea124d39a9988aa42e4e2908', 'request_id': 'req-b905c7ac-5600-4900-ab58-93cec3dad8bb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.133866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f822e508ea124d39a9988aa42e4e2908', 'request_id': 'req-b905c7ac-5600-4900-ab58-93cec3dad8bb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.143607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:43.150261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f822e508ea124d39a9988aa42e4e2908', 'request_id': 'req-b905c7ac-5600-4900-ab58-93cec3dad8bb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.199736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] The token cache is being invalidate because project f822e508ea124d39a9988aa42e4e2908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:43.202056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.204249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.212441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 896/1773] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:42 2022] DELETE /identity/v3/projects/f822e508ea124d39a9988aa42e4e2908 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:43.226406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:43.233511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:43.405170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfe4e9-9470-4c5d-8a41-760d9f0784d7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:43.538153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:43.539984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:43.540598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:43.541273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] PATH_INFO: `/v3/users/59a0114d3c9d4c57acbb9da23867c957` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:43.548588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a0114d3c9d4c57acbb9da23867c957)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:43.553098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:43.725708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:43.727761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:43.756823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c7ac-5600-4900-ab58-93cec3dad8bb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:43.777344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:43.781323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:43.781967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:43.782453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] PATH_INFO: `/v3/projects/c3724bf1454840eba3f2a19e0d2dc5cf` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:43.785555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3724bf1454840eba3f2a19e0d2dc5cf)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:43.790532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:43.790690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a0114d3c9d4c57acbb9da23867c957'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.791297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a0114d3c9d4c57acbb9da23867c957'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.822723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a0114d3c9d4c57acbb9da23867c957'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.865611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a0114d3c9d4c57acbb9da23867c957'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.868808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ff2b66e-fd0a-4ee9-a9a8-ca491f898d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a0114d3c9d4c57acbb9da23867c957'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.973183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3724bf1454840eba3f2a19e0d2dc5cf', 'request_id': 'req-a763db9a-1059-484a-90af-e78942af40bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:43.977026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 878/1774] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:43 2022] DELETE /identity/v3/users/59a0114d3c9d4c57acbb9da23867c957 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:44.071800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3724bf1454840eba3f2a19e0d2dc5cf', 'request_id': 'req-a763db9a-1059-484a-90af-e78942af40bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.096687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3724bf1454840eba3f2a19e0d2dc5cf', 'request_id': 'req-a763db9a-1059-484a-90af-e78942af40bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.117872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] The token cache is being invalidate because project c3724bf1454840eba3f2a19e0d2dc5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:44.118448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.120202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.122332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 897/1775] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:43 2022] DELETE /identity/v3/projects/c3724bf1454840eba3f2a19e0d2dc5cf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:44.133769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e5877-21ab-4de8-9914-5bb2ba6ab802 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:44.134354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e5877-21ab-4de8-9914-5bb2ba6ab802 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:44.134891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e5877-21ab-4de8-9914-5bb2ba6ab802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:44.185392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8f3e5877-21ab-4de8-9914-5bb2ba6ab802 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:44.188880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8f3e5877-21ab-4de8-9914-5bb2ba6ab802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:44.244664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:44.247260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:44.354394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 879/1776] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:44.362815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:44.363361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:44.363881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:44.412497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:44.418177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:44.440689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 880/1777] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:44.445019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:44.471463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246965-3bc2-44ec-959d-ee9be6987fc0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:44.489233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:44.490297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:44.490594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:44.490867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:44.491628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:44.491979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:44.495280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:44.495790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763db9a-1059-484a-90af-e78942af40bc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:44.501223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:44.502465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:44.502845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:44.503181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] PATH_INFO: `/v3/projects/67212cd8665d4056bac62b460a26f7a6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:44.505268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67212cd8665d4056bac62b460a26f7a6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:44.508867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:44.532249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:44.534389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 881/1778] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:47:44.535430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:44.539290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:44.570561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec63bef-538b-49f6-846c-46b725568f1d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:44.582195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:44.582933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:44.583228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:44.583550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] PATH_INFO: `/v3/projects/3faebdbef45d4b3696cbfbc733804309` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:44.585448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3faebdbef45d4b3696cbfbc733804309)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:44.587441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:44.719396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67212cd8665d4056bac62b460a26f7a6', 'request_id': 'req-09b86643-493b-403e-9152-063ab7c9676c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.760789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3faebdbef45d4b3696cbfbc733804309', 'request_id': 'req-40187e36-ab21-4f75-9e67-aa0b8c05b87d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.778497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3faebdbef45d4b3696cbfbc733804309', 'request_id': 'req-40187e36-ab21-4f75-9e67-aa0b8c05b87d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.801823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3faebdbef45d4b3696cbfbc733804309', 'request_id': 'req-40187e36-ab21-4f75-9e67-aa0b8c05b87d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.810451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67212cd8665d4056bac62b460a26f7a6', 'request_id': 'req-09b86643-493b-403e-9152-063ab7c9676c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.820389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67212cd8665d4056bac62b460a26f7a6', 'request_id': 'req-09b86643-493b-403e-9152-063ab7c9676c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.843634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] The token cache is being invalidate because project 67212cd8665d4056bac62b460a26f7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:44.843634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.844837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.849952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 898/1779] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:44 2022] DELETE /identity/v3/projects/67212cd8665d4056bac62b460a26f7a6 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:44.851396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:44.856852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:44.897161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] The token cache is being invalidate because project 3faebdbef45d4b3696cbfbc733804309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:44.898115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.899338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:44.908895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 882/1780] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:44 2022] DELETE /identity/v3/projects/3faebdbef45d4b3696cbfbc733804309 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:44.912320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:44.916211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:45.008040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:45.043656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86643-493b-403e-9152-063ab7c9676c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:45.089466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187e36-ab21-4f75-9e67-aa0b8c05b87d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:45.098020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:45.098757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.099163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.099548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] PATH_INFO: `/v3/users/856bafd2003f403c8343cc893a01edc5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.100804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856bafd2003f403c8343cc893a01edc5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:45.103736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:45.184983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68398d4d-2674-4597-ab4e-363a7ba5c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:45.185844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398d4d-2674-4597-ab4e-363a7ba5c54e admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.186290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398d4d-2674-4597-ab4e-363a7ba5c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.188005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398d4d-2674-4597-ab4e-363a7ba5c54e admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.188904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68398d4d-2674-4597-ab4e-363a7ba5c54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:45.192084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68398d4d-2674-4597-ab4e-363a7ba5c54e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:45.366519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 899/1781] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:44 2022] POST /identity/v3/projects => generated 385 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:45.366519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.366519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.366519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.391835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856bafd2003f403c8343cc893a01edc5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.395309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856bafd2003f403c8343cc893a01edc5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.409501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856bafd2003f403c8343cc893a01edc5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.417956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:45.419512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:45.436561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856bafd2003f403c8343cc893a01edc5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.438062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856bafd2003f403c8343cc893a01edc5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.528295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 900/1782] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:45.532862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:45.536677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:45.555357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 883/1783] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:44 2022] DELETE /identity/v3/users/856bafd2003f403c8343cc893a01edc5 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:45.555357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:45.556805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:45.557230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4fbb-c558-4c4d-8e66-e5e11c78d382 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:45.645738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fe212-e8d7-4985-94d3-e4e8b7d3dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:45.646668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fe212-e8d7-4985-94d3-e4e8b7d3dddd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.649733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fe212-e8d7-4985-94d3-e4e8b7d3dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.649733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fe212-e8d7-4985-94d3-e4e8b7d3dddd admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.649733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fe212-e8d7-4985-94d3-e4e8b7d3dddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:45.650787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fe212-e8d7-4985-94d3-e4e8b7d3dddd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:45.712751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9d38-c07a-44a5-b39b-91f345abde04 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:45.718714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:45.719499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.719784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.720058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] PATH_INFO: `/v3/projects/df8f90eb33564caba2a9f7abfc6c6415` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.722500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8f90eb33564caba2a9f7abfc6c6415)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:45.726431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:45.784164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 901/1784] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:45 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:45.785809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.786250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.786705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.825626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:45.829459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:45.853967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 902/1785] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:45.855120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:45.874894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767bcb-b967-4e66-848b-28493988e7b6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:45.883124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:45.883789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:45.884119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:45.884400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:45.885054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:45.886693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:45.928804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 903/1786] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:45.928804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:45.932798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8f90eb33564caba2a9f7abfc6c6415', 'request_id': 'req-57190635-006d-4d56-b1b9-e01b641508ed'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.947684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8f90eb33564caba2a9f7abfc6c6415', 'request_id': 'req-57190635-006d-4d56-b1b9-e01b641508ed'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.951661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944da3e-5f9a-47c5-b471-9c186668e00a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:45.964659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8f90eb33564caba2a9f7abfc6c6415', 'request_id': 'req-57190635-006d-4d56-b1b9-e01b641508ed'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:45.987795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:46.054626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] The token cache is being invalidate because project df8f90eb33564caba2a9f7abfc6c6415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:46.055327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.056297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.062687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 884/1787] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:45 2022] DELETE /identity/v3/projects/df8f90eb33564caba2a9f7abfc6c6415 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:46.063972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:46.073945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:46.115523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:46.117344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.118209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.119499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.121915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:46.123337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:46.129812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:46.156295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 904/1788] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:46.157158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:46.159075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:46.175244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae8d91-c252-47e9-a66e-b3e91a923cf8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:46.180834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57190635-006d-4d56-b1b9-e01b641508ed admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:46.182426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:46.183183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.183572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.183866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] PATH_INFO: `/v3/projects/2174feedeca64c09abd86a32a913b2b0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.185175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2174feedeca64c09abd86a32a913b2b0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:46.188234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:46.197770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efd562-67f0-46a1-9d02-cb65f1ef7505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:46.199295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efd562-67f0-46a1-9d02-cb65f1ef7505 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.200389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efd562-67f0-46a1-9d02-cb65f1ef7505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.201152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efd562-67f0-46a1-9d02-cb65f1ef7505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.202338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efd562-67f0-46a1-9d02-cb65f1ef7505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:46.209157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efd562-67f0-46a1-9d02-cb65f1ef7505 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:46.232406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 885/1789] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:46.234108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.234456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.234795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.262305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:46.264127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:46.274006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 886/1790] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:46.274975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:46.285133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:46.303691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e6c38-6178-44fb-b4d5-0ddb071bdfd8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:46.326326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2174feedeca64c09abd86a32a913b2b0', 'request_id': 'req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.389450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:46.433419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18966c-4f92-4c54-9213-8cef2b77b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:46.433419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18966c-4f92-4c54-9213-8cef2b77b58b admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.433419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18966c-4f92-4c54-9213-8cef2b77b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.433419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18966c-4f92-4c54-9213-8cef2b77b58b admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.434367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18966c-4f92-4c54-9213-8cef2b77b58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:46.434367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18966c-4f92-4c54-9213-8cef2b77b58b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:46.661402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2174feedeca64c09abd86a32a913b2b0', 'request_id': 'req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.661402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2174feedeca64c09abd86a32a913b2b0', 'request_id': 'req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.661402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] The token cache is being invalidate because project 2174feedeca64c09abd86a32a913b2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:46.661402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.662067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:46.662067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 905/1791] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:46 2022] DELETE /identity/v3/projects/2174feedeca64c09abd86a32a913b2b0 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:46.662067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:46.662067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:46.662067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39aa2e-e28c-4104-bd2d-7f20b2764db9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:46.662976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec15ef-0613-42ca-8f53-e5e5d5e8f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:46.662976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec15ef-0613-42ca-8f53-e5e5d5e8f933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.662976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec15ef-0613-42ca-8f53-e5e5d5e8f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.662976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec15ef-0613-42ca-8f53-e5e5d5e8f933 admin admin] PATH_INFO: `/v3/projects/2efb4f9ca8c9411a98a900dd4b46d46d/users/15887f4877e647d790a4e99f466fde42/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.663255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec15ef-0613-42ca-8f53-e5e5d5e8f933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efb4f9ca8c9411a98a900dd4b46d46d, user_id=15887f4877e647d790a4e99f466fde42, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:46.663255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec15ef-0613-42ca-8f53-e5e5d5e8f933 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:46.979460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 906/1792] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:46 2022] PUT /identity/v3/projects/2efb4f9ca8c9411a98a900dd4b46d46d/users/15887f4877e647d790a4e99f466fde42/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:46.979460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f887e-c717-4e26-85f9-047d4d785404 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.980171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 887/1793] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:46 2022] POST /identity/v3/projects => generated 381 bytes in 693 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:46.980609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f887e-c717-4e26-85f9-047d4d785404 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.980609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f887e-c717-4e26-85f9-047d4d785404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.980792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:46.980792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:46.980792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:46.990753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:46.991940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7d3f887e-c717-4e26-85f9-047d4d785404 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:46.992067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:46.993102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7d3f887e-c717-4e26-85f9-047d4d785404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:47.062951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 888/1794] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:47.064582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.066143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:47.078734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734bb30-81b2-41c0-8efd-1b39e24fbfcd None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.083699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 907/1795] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:47.085157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c7ecf-87bd-4e2f-b7ea-3e55d8b7bfd6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.085447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c7ecf-87bd-4e2f-b7ea-3e55d8b7bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.085731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c7ecf-87bd-4e2f-b7ea-3e55d8b7bfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.088116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.088744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.089266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.089763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.090910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.094813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.116967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3e7c7ecf-87bd-4e2f-b7ea-3e55d8b7bfd6 None None] MFA Rules not processed for user `15887f4877e647d790a4e99f466fde42`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:47.118198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3e7c7ecf-87bd-4e2f-b7ea-3e55d8b7bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:47.186056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 908/1796] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:47.186056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.186056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.186056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.205158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:47.206371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:47.214343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 909/1797] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:47.215219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.225916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967498e8-ac83-4c91-89a3-69fa65dc5d19 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.231011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.231538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.231830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.232103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.232756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:47.233071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.234657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 889/1798] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.234771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.235911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.249414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 910/1799] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:47.250275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.259791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152a31d-db2c-4db2-9a6b-69e4f4d878c9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.264590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.265001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8f2a4-c710-4ea6-9f48-c9a6c535276a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.265337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.265730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.266019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.267157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.269956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.270989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.271631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.271916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.272187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.272831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:47.273136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.274862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.301891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 911/1800] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:47.302818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.315632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be742e1-f310-4c1c-a93c-e787b5162e45 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.321740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.322396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.322737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.323021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.323758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.325391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.340123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 912/1801] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:47.340123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.354681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 890/1802] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.357279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.357396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25030a77-0ea6-4798-93b9-d7d33e3623be admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.437604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.438292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.438577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.438905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.439634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.442216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.475340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9766d-a97f-45ad-90d7-33f1067e63f2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.484995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.485552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.485838 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.486846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.487522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.489449 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.532365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 913/1803] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.532365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.593125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7049955-c377-4a92-8ecf-9a581577042a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.600319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.601051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.601431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.601848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.602568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.606710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 891/1804] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/projects => generated 393 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.606850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.606946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.616682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 914/1805] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:47.617819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.628802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e33b4-82b8-46bf-b49c-81f9496e6a07 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.671850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d0989-085c-4714-880f-f1e191209913 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.677896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.678784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.679059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.679349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.680085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.682072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.686809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.687464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.687755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.688193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:47.688301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.688845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.690875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.820693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 892/1806] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.820851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.836063 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116626-3ca9-4402-b055-6aefdf8bbe17 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.838043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.838658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.838946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.839231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.842789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 915/1807] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.842930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.843015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.843103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.857098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16d4ee-5f15-44aa-bbf3-9b4ac8511225 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.862608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.863274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.864356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.864356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] PATH_INFO: `/v3/projects/f9e1c2a46aed47b5b8b0aae8867d56e9/users/6309ba77ea0c4363b1677ff6f25a8517/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.880523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e1c2a46aed47b5b8b0aae8867d56e9, user_id=6309ba77ea0c4363b1677ff6f25a8517, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.884054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.919049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 893/1808] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:47 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:47.920292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.931944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d611f-20f4-41e8-aac5-8f5ddcf7f1a3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.936377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:47.937013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:47.937304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:47.937622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:47.938369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:47.940584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:47.952110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 894/1809] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:47.952703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.963906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 916/1810] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:47 2022] PUT /identity/v3/projects/f9e1c2a46aed47b5b8b0aae8867d56e9/users/6309ba77ea0c4363b1677ff6f25a8517/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:47.964244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d47e-a962-4451-b094-bde1c0c5ea55 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:47.964330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:47.985259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:48.037963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.038855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.039144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.039768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.041261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.044382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.051144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50bab-bc73-4ced-bb32-7a2750a8cedc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.061708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8140065-4b35-41d9-82df-252bef33e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.062338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8140065-4b35-41d9-82df-252bef33e22b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.062651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8140065-4b35-41d9-82df-252bef33e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.063129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8140065-4b35-41d9-82df-252bef33e22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.063879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8140065-4b35-41d9-82df-252bef33e22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.067668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 895/1811] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:48.067668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.067912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8140065-4b35-41d9-82df-252bef33e22b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.078870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 917/1812] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:48.079276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d952a-12a9-4c5e-bb00-7252680e963a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.081122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.081409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.081721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.086312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.086983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.087269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.087587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] PATH_INFO: `/v3/projects/3a6e044d28d742abb9021e056d8ec91b/users/965d4dc76211406b861717893939ee15/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.102518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6e044d28d742abb9021e056d8ec91b, user_id=965d4dc76211406b861717893939ee15, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.105448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.109793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] MFA Rules not processed for user `6309ba77ea0c4363b1677ff6f25a8517`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:48.111052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:48.174542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 918/1813] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:48.175387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.179561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 896/1814] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:48 2022] PUT /identity/v3/projects/3a6e044d28d742abb9021e056d8ec91b/users/965d4dc76211406b861717893939ee15/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:48.182975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.188624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352db73b-0818-4918-8f96-a84b2865ad24 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.244501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf6d99-093f-4335-80ff-784c1ee23b04 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.245859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.246466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.246747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.247021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.247695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.249286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.249394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.250122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.250422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.250689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.251598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.253244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.259675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 919/1815] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:48.260482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.267416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 897/1816] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:48.270706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede2d7a-4a14-443d-b87f-25469a0592a7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.271289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.275524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.276137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.276421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.276697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.277338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.279336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.287303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418396-81a8-42e9-a602-0237dd537947 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.293230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.293897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.294225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.294462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.295290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.296958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.308462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 898/1817] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:48.309292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.319553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a63ee-8745-438b-92e9-31146320d42c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.324284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.324937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.325273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.325556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] PATH_INFO: `/v3/projects/e9d95081f28541afb205394eecb13ee4/users/e06a8508bdb14a79a2a773a217e43a83/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.342159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d95081f28541afb205394eecb13ee4, user_id=e06a8508bdb14a79a2a773a217e43a83, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.346517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.373408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 920/1818] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:48.373408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.430318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 899/1819] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:48 2022] PUT /identity/v3/projects/e9d95081f28541afb205394eecb13ee4/users/e06a8508bdb14a79a2a773a217e43a83/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:48.441210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.456483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e958e-1388-46b6-abef-b7da40098bd1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.503610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50605c4-26dc-440d-9f7c-9052c451a5cb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.510951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.512515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.513008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.513387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] PATH_INFO: `/v3/projects/3a6e044d28d742abb9021e056d8ec91b/users/965d4dc76211406b861717893939ee15/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.516535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6e044d28d742abb9021e056d8ec91b, user_id=965d4dc76211406b861717893939ee15, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.519510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.536907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 900/1820] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:48 2022] PUT /identity/v3/projects/3a6e044d28d742abb9021e056d8ec91b/users/965d4dc76211406b861717893939ee15/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:48.537793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.553649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3a02b-5e27-42c4-8778-c37da47603c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.554649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a02b-5e27-42c4-8778-c37da47603c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.557130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a02b-5e27-42c4-8778-c37da47603c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.557130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3a02b-5e27-42c4-8778-c37da47603c5 admin admin] PATH_INFO: `/v3/projects/f28bec4bf3604e6eba1c9ec23f11be14/users/ea7756a3124b4ddea5ef0b33e681481f/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.573502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a02b-5e27-42c4-8778-c37da47603c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28bec4bf3604e6eba1c9ec23f11be14, user_id=ea7756a3124b4ddea5ef0b33e681481f, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.576586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3a02b-5e27-42c4-8778-c37da47603c5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.580804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:48.615259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7a37f-17f4-42af-9117-b18c89657d6a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.620434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570140a-742f-4039-9749-9c28f06794bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.621290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570140a-742f-4039-9749-9c28f06794bf admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.621290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570140a-742f-4039-9749-9c28f06794bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.621813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570140a-742f-4039-9749-9c28f06794bf admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.622320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570140a-742f-4039-9749-9c28f06794bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.624419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570140a-742f-4039-9749-9c28f06794bf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.671547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 921/1821] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:48 2022] PUT /identity/v3/projects/f28bec4bf3604e6eba1c9ec23f11be14/users/ea7756a3124b4ddea5ef0b33e681481f/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:48.671547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8e5c6-ca40-4956-881b-35913b88a1db None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.671547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8e5c6-ca40-4956-881b-35913b88a1db None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.671547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8e5c6-ca40-4956-881b-35913b88a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.698152 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-efd8e5c6-ca40-4956-881b-35913b88a1db None None] MFA Rules not processed for user `e06a8508bdb14a79a2a773a217e43a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:48.699361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-efd8e5c6-ca40-4956-881b-35913b88a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:48.740721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 901/1822] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:48.742018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.742312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.742595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.752564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:48.770902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 922/1823] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:48.774576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.774576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.774576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.778739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] MFA Rules not processed for user `965d4dc76211406b861717893939ee15`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:48.780004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:48.802738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] MFA Rules not processed for user `ea7756a3124b4ddea5ef0b33e681481f`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:48.803910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:48.863619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 902/1824] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:48.863619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.877178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 923/1825] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:48.878544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.952131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11b40c-d1fa-49b3-be66-51441c752c6e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.959617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.960393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.960680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.961044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.961684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.962422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5de928-6e94-4e7b-ab26-bc694d96b1a9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:48.965663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.967092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:48.967732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:48.968015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:48.968288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:48.968920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:48.971752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:48.978288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 903/1826] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:48.979310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:48.983688 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:49.045146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7c206-5b19-4464-af05-443de4a615df admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.050351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.051071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.051273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.051575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.061167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.063818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.072986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 904/1827] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:49.073873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.088523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ca493-c2ce-4da5-ba3f-e4648c7ba36d service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.097850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.098943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.099271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.099594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.100291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.102272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.106206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 924/1828] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:48 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:49.106206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.179022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 905/1829] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:49 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:49.179022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.197113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1844be-e95f-4ecf-95da-c51368d52974 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.253230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c896-6749-4712-accc-c9228093407f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.258758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.259777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.259777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.260002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.260564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.262153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.262531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.262812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.263090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.263442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] PATH_INFO: `/v3/projects/3d74b120380c45768ef232ff3bc5f85a/users/27ccede1e5624b729a8aa6e604b18ba4/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.280510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d74b120380c45768ef232ff3bc5f85a, user_id=27ccede1e5624b729a8aa6e604b18ba4, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.283842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.362243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 906/1830] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:49 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:49.363117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.373316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 925/1831] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:49 2022] PUT /identity/v3/projects/3d74b120380c45768ef232ff3bc5f85a/users/27ccede1e5624b729a8aa6e604b18ba4/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:49.373594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fcdf-6110-4d89-aa4e-93f3f83f8b91 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.374386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.434645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.435292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.435700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.435984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] PATH_INFO: `/v3/users/15887f4877e647d790a4e99f466fde42` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.436963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67fa3-fa03-442e-bae1-d138c14243c5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.437165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15887f4877e647d790a4e99f466fde42)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.439118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.443519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.444185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.445550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:49.446063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.446449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.447290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.449426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.538620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 926/1832] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:49 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:49.539471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.546906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:49.553050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebebb-feb9-4426-8b7e-291baa5f4d27 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.554803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.555447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.555737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.556017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.556665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.558255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.569077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 927/1833] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:49.569971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.579570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311d12-8812-4b23-9c7d-630a89bb9a73 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.584901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.585804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.586096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.586375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.586982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.589114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.599464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 928/1834] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:49.600513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.609713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3a26-b5c4-4b25-8cdb-cd9806d40a06 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.614468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.614968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.615252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.615573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.616223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.617825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.627978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 929/1835] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:49.628860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.638426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426280a-8152-4c33-a584-ffa5a3aed9f3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.644001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.644573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.644873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.645136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.645784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.647336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.657013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 930/1836] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:49.657877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.667612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15887f4877e647d790a4e99f466fde42'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:49.667778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea702631-d7c6-4317-8ad6-c9fbe7358b71 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.668275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15887f4877e647d790a4e99f466fde42'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:49.672340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.672965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.673248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.675300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15887f4877e647d790a4e99f466fde42'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:49.675434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] PATH_INFO: `/v3/projects/3d74b120380c45768ef232ff3bc5f85a/users/27ccede1e5624b729a8aa6e604b18ba4/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.677367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d74b120380c45768ef232ff3bc5f85a, user_id=27ccede1e5624b729a8aa6e604b18ba4, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.680053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.688574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15887f4877e647d790a4e99f466fde42'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:49.689818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15887f4877e647d790a4e99f466fde42'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:49.693195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 931/1837] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:49 2022] PUT /identity/v3/projects/3d74b120380c45768ef232ff3bc5f85a/users/27ccede1e5624b729a8aa6e604b18ba4/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:49.694071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.703496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:49.769453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 907/1838] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:49 2022] DELETE /identity/v3/users/15887f4877e647d790a4e99f466fde42 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:49.770978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4529c83-baf9-4671-b4e3-383dd069ef7b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.773559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:49.774970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:49.842535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00546-c60b-483a-9734-e4a235d93e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.846478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00546-c60b-483a-9734-e4a235d93e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.846478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00546-c60b-483a-9734-e4a235d93e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.846478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00546-c60b-483a-9734-e4a235d93e2e admin admin] PATH_INFO: `/v3/projects/335eddc96aab4630a6286a7d32918fb6/users/449d590e8f42485a827c33431cb4fcca/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.846712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e475-7459-43c3-845f-e7e74e7e7e65 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:49.850788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312ba1-dbba-4b68-a9fa-f220b768b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:49.851760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312ba1-dbba-4b68-a9fa-f220b768b3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.852260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312ba1-dbba-4b68-a9fa-f220b768b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.852804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312ba1-dbba-4b68-a9fa-f220b768b3d3 admin admin] PATH_INFO: `/v3/projects/526952d9e4c442baa172e846e363805d/users/ed366dd2a4e34b1386ac83b7ee180930/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.862286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00546-c60b-483a-9734-e4a235d93e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=335eddc96aab4630a6286a7d32918fb6, user_id=449d590e8f42485a827c33431cb4fcca, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.865426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00546-c60b-483a-9734-e4a235d93e2e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.870160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312ba1-dbba-4b68-a9fa-f220b768b3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526952d9e4c442baa172e846e363805d, user_id=ed366dd2a4e34b1386ac83b7ee180930, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:49.875099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312ba1-dbba-4b68-a9fa-f220b768b3d3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:49.956034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 932/1839] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:49 2022] PUT /identity/v3/projects/335eddc96aab4630a6286a7d32918fb6/users/449d590e8f42485a827c33431cb4fcca/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:49.957082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:49.957367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:49.957681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:49.988102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] MFA Rules not processed for user `27ccede1e5624b729a8aa6e604b18ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:49.989346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.004959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 908/1840] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:49 2022] PUT /identity/v3/projects/526952d9e4c442baa172e846e363805d/users/ed366dd2a4e34b1386ac83b7ee180930/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:50.006250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57f6b-7eab-4403-b884-f975cd05dca4 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.006667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57f6b-7eab-4403-b884-f975cd05dca4 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.006949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57f6b-7eab-4403-b884-f975cd05dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.028190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-dfb57f6b-7eab-4403-b884-f975cd05dca4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:50.029403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dfb57f6b-7eab-4403-b884-f975cd05dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.060372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 933/1841] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:50.061219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.096255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 909/1842] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:50.098370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.098853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.099298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.105993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:50.132186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] MFA Rules not processed for user `ed366dd2a4e34b1386ac83b7ee180930`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:50.133427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.138539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c268a9-d073-487d-9d91-3c9541df1f1f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.141551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:50.144340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.145556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.145556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.145556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.146126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.147758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.162236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 934/1843] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:50.162236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.162236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.228499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 910/1844] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:50.228499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.228785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e584-6de5-4662-a07a-3ca2ad90cbfc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.228881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.231629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.232329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.232684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.233144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.291011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4af367-01d5-48c5-b68e-44c2f9de1b49 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.294899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.295548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.295825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.296096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.303161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.304669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.308043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.310128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.315531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 935/1845] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:50.316432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.321007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 911/1846] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:50.321816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.327169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b607b7-2186-4c7a-ad83-c7d2b4e7247a service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.333009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ece6d-3ff7-48b3-af19-a3403b8bd96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.333321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ece6d-3ff7-48b3-af19-a3403b8bd96c admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.333572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ece6d-3ff7-48b3-af19-a3403b8bd96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.333778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf07c6-c194-43a1-bb91-ed925d8d75dd service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.333898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ece6d-3ff7-48b3-af19-a3403b8bd96c admin admin] PATH_INFO: `/v3/projects/335eddc96aab4630a6286a7d32918fb6/users/449d590e8f42485a827c33431cb4fcca/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.336092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ece6d-3ff7-48b3-af19-a3403b8bd96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=335eddc96aab4630a6286a7d32918fb6, user_id=449d590e8f42485a827c33431cb4fcca, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.338808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ece6d-3ff7-48b3-af19-a3403b8bd96c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.347764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.348379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.349007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.349007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.349554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.351580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.358369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 936/1847] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:50 2022] PUT /identity/v3/projects/335eddc96aab4630a6286a7d32918fb6/users/449d590e8f42485a827c33431cb4fcca/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:50.369408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.370016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.370297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.409598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] MFA Rules not processed for user `449d590e8f42485a827c33431cb4fcca`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:50.410961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.419055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:50.457057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 912/1848] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:50 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:50.457575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.503644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 937/1849] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:50.507771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.517140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:50.536200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9961a-7335-4b99-a1b5-0a852dc19da0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.539986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.540603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.540887 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.541161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.542912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.573487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaef08-b6bf-402c-8fd2-2da747830162 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.604004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.605574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.619607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 913/1850] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:50.620486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.622442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.637038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.637038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.637331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862491f7-b199-4093-a5bd-3301fe0b88e5 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.637439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.637439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.637843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.640333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.648775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.649503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.649680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.649957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.740793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.743293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.758414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 914/1851] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:50.805464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.807895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 938/1852] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:50 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:50.817597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ce457-ff16-4239-9a60-7338046878ac service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.823752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.824712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.825483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.825942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.827750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.828430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.831166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.840621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43946-775e-4aa4-b4a6-567b5d57877b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.843836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 915/1853] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:50.847895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.848158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.849001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.849389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.850076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.852565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.870347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e88e6-427d-40d6-801c-8a624c67e2a1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.878045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.878776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.879066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.879349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] PATH_INFO: `/v3/projects/b5f8d22c99d341ecb1ff43c70669cc54/users/02e71cf6d2e94267ae2e08e0d266c1f2/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.902888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f8d22c99d341ecb1ff43c70669cc54, user_id=02e71cf6d2e94267ae2e08e0d266c1f2, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.905947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.917927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:50.946852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.948652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:50.967075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 939/1854] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:47:50.968243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:50.969828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:50.985755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2dbc-4f6d-488a-b967-409ffadc7905 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:50.997073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:50.997073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:50.997073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:50.997073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] PATH_INFO: `/v3/projects/2efb4f9ca8c9411a98a900dd4b46d46d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:50.997979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efb4f9ca8c9411a98a900dd4b46d46d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:50.997979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:51.020780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 916/1855] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:50 2022] PUT /identity/v3/projects/b5f8d22c99d341ecb1ff43c70669cc54/users/02e71cf6d2e94267ae2e08e0d266c1f2/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:51.026575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:51.148108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618880e1-9d02-49dd-9373-3f47dd7a2b60 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:51.154904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:51.175132 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efb4f9ca8c9411a98a900dd4b46d46d', 'request_id': 'req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.237620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efb4f9ca8c9411a98a900dd4b46d46d', 'request_id': 'req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.258203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efb4f9ca8c9411a98a900dd4b46d46d', 'request_id': 'req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.276170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] The token cache is being invalidate because project 2efb4f9ca8c9411a98a900dd4b46d46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:51.278349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.279949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.286044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 940/1856] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:50 2022] DELETE /identity/v3/projects/2efb4f9ca8c9411a98a900dd4b46d46d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:51.288140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:51.288858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:51.289128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:51.290494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:51.291269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:51.292863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:51.294319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:51.295801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:51.327250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb42bb2-8e33-416c-9ba0-aee97b1b2950 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:51.332272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 917/1857] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:51.336859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:51.341293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:51.342458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:51.343669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:51.343961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:51.344244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] PATH_INFO: `/v3/users/965d4dc76211406b861717893939ee15` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:51.345762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=965d4dc76211406b861717893939ee15)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:51.348331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:51.369024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353b3a-94a6-401b-b1c0-173047475de4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:51.375976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743d0b-9ccc-49cc-ae57-c9716eef296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:51.377815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743d0b-9ccc-49cc-ae57-c9716eef296b admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:51.378484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743d0b-9ccc-49cc-ae57-c9716eef296b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:51.378970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743d0b-9ccc-49cc-ae57-c9716eef296b admin admin] PATH_INFO: `/v3/projects/b5f8d22c99d341ecb1ff43c70669cc54/users/02e71cf6d2e94267ae2e08e0d266c1f2/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:51.381470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743d0b-9ccc-49cc-ae57-c9716eef296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f8d22c99d341ecb1ff43c70669cc54, user_id=02e71cf6d2e94267ae2e08e0d266c1f2, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:51.385139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743d0b-9ccc-49cc-ae57-c9716eef296b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:51.398018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 918/1858] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:51 2022] PUT /identity/v3/projects/b5f8d22c99d341ecb1ff43c70669cc54/users/02e71cf6d2e94267ae2e08e0d266c1f2/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:51.408586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:51.408877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:51.409159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:51.452255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] MFA Rules not processed for user `02e71cf6d2e94267ae2e08e0d266c1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:51.454047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:51.574641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 919/1859] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:51.597778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965d4dc76211406b861717893939ee15'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.643894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:51.650436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:51.652252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:51.681887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965d4dc76211406b861717893939ee15'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.703272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965d4dc76211406b861717893939ee15'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.724168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965d4dc76211406b861717893939ee15'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.724907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965d4dc76211406b861717893939ee15'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:51.741495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 941/1860] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:51 2022] DELETE /identity/v3/users/965d4dc76211406b861717893939ee15 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:51.750803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea519950-060b-4ed7-b609-9aca333f2df2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:51.810114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:51.815764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:51.817241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:51.817723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:51.818211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:51.821248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:51.911606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:51.916618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:51.931725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 920/1861] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:52.847074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:52.851757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:52.893738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a58834-92a6-4882-9d72-79043c401b1f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:52.899784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:52.900463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:52.904903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:52.904903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:52.907018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:53.007475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:53.009051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327be9d-c479-4ab9-b705-21e45326326f service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:53.023182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 942/1862] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:53.152216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:53.153948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:53.244537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc0088-e59d-4934-8ff8-08767bb42de2 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:53.249717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:53.250436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.250799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.251086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] PATH_INFO: `/v3/projects/3a6e044d28d742abb9021e056d8ec91b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.252514 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6e044d28d742abb9021e056d8ec91b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:53.254526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:53.371855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6e044d28d742abb9021e056d8ec91b', 'request_id': 'req-284bd32a-0471-4f11-ae3f-3ca636c5c56e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:53.375201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e10a6-c096-41d8-97ad-75259ddcdf0f None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.375539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e10a6-c096-41d8-97ad-75259ddcdf0f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.375779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e10a6-c096-41d8-97ad-75259ddcdf0f None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.378372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 943/1863] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:47:53.384533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6e044d28d742abb9021e056d8ec91b', 'request_id': 'req-284bd32a-0471-4f11-ae3f-3ca636c5c56e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:53.397412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6e044d28d742abb9021e056d8ec91b', 'request_id': 'req-284bd32a-0471-4f11-ae3f-3ca636c5c56e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:53.397545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8a6d-aa7e-46c1-966f-4edbbe4a84c6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.397907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8a6d-aa7e-46c1-966f-4edbbe4a84c6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.398672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8a6d-aa7e-46c1-966f-4edbbe4a84c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.426231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-889a8a6d-aa7e-46c1-966f-4edbbe4a84c6 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:53.428449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-889a8a6d-aa7e-46c1-966f-4edbbe4a84c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:53.478289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] The token cache is being invalidate because project 3a6e044d28d742abb9021e056d8ec91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:53.478772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:53.480079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-284bd32a-0471-4f11-ae3f-3ca636c5c56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:53.482248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 921/1864] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:53 2022] DELETE /identity/v3/projects/3a6e044d28d742abb9021e056d8ec91b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:53.509691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.509991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.512717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.551259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 944/1865] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:53.560731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:53.562060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:53.643426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 922/1866] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:53.649523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.650272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.650586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.663227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:53.668549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:53.680845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:53.682066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:53.694061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a9bd7-dee0-4e01-a29f-52c5153c88c2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:53.696556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 945/1867] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:53.697480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:53.699987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:53.700603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.700954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.701236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.705316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:53.713432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:53.723595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:53.724061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91412b65-d670-446d-a51f-2d81bdee41ae None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:53.733920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:53.734550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.734837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.735116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.736922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:53.737234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:53.738129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 923/1868] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:53.757277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:53.768046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 946/1869] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:53.772371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:53.785731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539ebb8-5cb5-4f17-adfe-459e8e1d1182 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:53.792386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:53.793282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:53.793976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:53.794506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:53.795454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:53.797499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:53.936292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 924/1870] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:53 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:47:53.958694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:53.982708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13594ca-f821-47ae-b6fa-e849caf74bac admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:54.114670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:54.115515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.116059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.116453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.117493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:54.120206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:54.315193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 947/1871] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:53 2022] POST /identity/v3/users => generated 305 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:54.316358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:54.327782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeca047-900a-4495-9299-1fa22bb5d868 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:54.333794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:54.334426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.334778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.335038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.335811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:54.344558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:54.352070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 925/1872] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:47:54.353791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:54.366728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50a2c-b4c4-4f17-bac7-a86372780efa admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:54.373768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97940e2a-c9ca-4e48-a057-f7fcec08201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:54.374723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940e2a-c9ca-4e48-a057-f7fcec08201f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.375415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940e2a-c9ca-4e48-a057-f7fcec08201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.375952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940e2a-c9ca-4e48-a057-f7fcec08201f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.377157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97940e2a-c9ca-4e48-a057-f7fcec08201f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:54.379012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97940e2a-c9ca-4e48-a057-f7fcec08201f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:54.394511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 948/1873] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:54.399216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:54.414399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cbf5f-7f11-454a-9650-a9d4aa84be19 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:54.421847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:54.423403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.429209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.429209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] PATH_INFO: `/v3/projects/50c13a127aee494cbaefd80eadae8a88/users/2002f1f630714c38ab5b4be2d4a7add4/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.442138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c13a127aee494cbaefd80eadae8a88, user_id=2002f1f630714c38ab5b4be2d4a7add4, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:54.445553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:54.556294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 926/1874] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:54 2022] PUT /identity/v3/projects/50c13a127aee494cbaefd80eadae8a88/users/2002f1f630714c38ab5b4be2d4a7add4/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:54.557974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.558474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.558802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.600713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] MFA Rules not processed for user `2002f1f630714c38ab5b4be2d4a7add4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:54.604302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:54.683725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 949/1875] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:54.688075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:54.764326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301618-3e96-485d-8e18-cbb51e8355f8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:54.770822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:54.771655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.772064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.772447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.773231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:54.775739 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:54.888666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 927/1876] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:54 2022] POST /identity/v3/projects => generated 407 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:47:54.893743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:54.904638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fd71b-9a93-489e-9572-ed5548068c95 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:54.983919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:54.983919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:54.984957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:54.984957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:54.984957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:54.987637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:54.988406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:55.117372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 950/1877] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:54 2022] POST /identity/v3/users => generated 310 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:47:55.118298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.133729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1356d-165a-410f-91cd-8692ce6b02a1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:55.144698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:55.145779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.146295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.146992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.148799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:55.151116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:55.164345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 928/1878] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:55.168713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.180930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ab92-20e3-425d-946e-2f06106d1e99 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:55.188283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:55.189438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.189934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.190330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] PATH_INFO: `/v3/projects/5af97ed349ae49c09976ff81930efa94/users/4f5d4c30a6d54db188282df3bb46e0c8/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.210151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af97ed349ae49c09976ff81930efa94, user_id=4f5d4c30a6d54db188282df3bb46e0c8, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:55.212904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:55.397350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 951/1879] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:55 2022] PUT /identity/v3/projects/5af97ed349ae49c09976ff81930efa94/users/4f5d4c30a6d54db188282df3bb46e0c8/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:55.401689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.413016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec93f0-e676-4dbf-9c9c-b5739f736950 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:55.502194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.505188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:55.507458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:55.508082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.508356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.509526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.510421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:55.512693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:55.521987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae320e-56b7-4f36-a9a1-03dca16fe3ad admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:55.527205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 929/1880] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:47:55.530587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.534903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:55.535651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.535929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.536211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] PATH_INFO: `/v3/users/6309ba77ea0c4363b1677ff6f25a8517` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.537416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6309ba77ea0c4363b1677ff6f25a8517)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:55.539332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:55.542716 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de7ba4-1a38-4f3a-8993-167c5f6fdc88 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:55.548142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ce7f5-25cb-4df8-8464-992ea036d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:55.548989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ce7f5-25cb-4df8-8464-992ea036d645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.554498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ce7f5-25cb-4df8-8464-992ea036d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.554498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ce7f5-25cb-4df8-8464-992ea036d645 admin admin] PATH_INFO: `/v3/projects/5af97ed349ae49c09976ff81930efa94/users/4f5d4c30a6d54db188282df3bb46e0c8/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.554498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ce7f5-25cb-4df8-8464-992ea036d645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af97ed349ae49c09976ff81930efa94, user_id=4f5d4c30a6d54db188282df3bb46e0c8, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:55.554498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ce7f5-25cb-4df8-8464-992ea036d645 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:55.568829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 930/1881] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:55 2022] PUT /identity/v3/projects/5af97ed349ae49c09976ff81930efa94/users/4f5d4c30a6d54db188282df3bb46e0c8/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:55.581363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.587170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.587170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.611885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] MFA Rules not processed for user `4f5d4c30a6d54db188282df3bb46e0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:55.613251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:55.681786 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 931/1882] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:55.706411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.707889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:55.744454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6309ba77ea0c4363b1677ff6f25a8517'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:55.767636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba917243-1ab2-4024-b91e-9c98cb7c6e78 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:55.771864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef068620-0f2b-488f-a133-37a130aaa2b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:55.772484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068620-0f2b-488f-a133-37a130aaa2b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.772789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068620-0f2b-488f-a133-37a130aaa2b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.773066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068620-0f2b-488f-a133-37a130aaa2b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.786483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef068620-0f2b-488f-a133-37a130aaa2b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:55.786483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef068620-0f2b-488f-a133-37a130aaa2b0 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:55.793422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 932/1883] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:47:55.806227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6309ba77ea0c4363b1677ff6f25a8517'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:55.820718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6309ba77ea0c4363b1677ff6f25a8517'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:55.828340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6309ba77ea0c4363b1677ff6f25a8517'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:55.829149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6309ba77ea0c4363b1677ff6f25a8517'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:55.847844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 952/1884] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:55 2022] DELETE /identity/v3/users/6309ba77ea0c4363b1677ff6f25a8517 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:55.848014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:55.848014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:55.848014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:55.868570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:55.869890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:55.936413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 933/1885] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:55.946589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:55.948054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:56.001395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:56.013039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4ad0-ad53-450a-af5c-2eae968ec2c0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:56.018907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:56.019571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:56.019854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:56.020131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:56.029401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:56.030840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:56.041533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 953/1886] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:56.287124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:56.288598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:56.406791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3dce2-48cb-43b7-ac0d-13eb339e3e2f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:56.411683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:56.412306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:56.413319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:56.413762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:56.415742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:56.517102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:56.519019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:56.556810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 934/1887] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:56.647051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:56.648833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:56.684766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1122-25e5-4687-abeb-693ef6243e2e service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:56.718613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:56.719430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:56.719720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:56.720103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] PATH_INFO: `/v3/projects/f9e1c2a46aed47b5b8b0aae8867d56e9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:56.721403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e1c2a46aed47b5b8b0aae8867d56e9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:56.723408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:56.834560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:56.854541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e1c2a46aed47b5b8b0aae8867d56e9', 'request_id': 'req-8637755e-de7e-40c5-8c17-dc57e2c923a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:56.919801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e1c2a46aed47b5b8b0aae8867d56e9', 'request_id': 'req-8637755e-de7e-40c5-8c17-dc57e2c923a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:56.920023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:56.926750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e1c2a46aed47b5b8b0aae8867d56e9', 'request_id': 'req-8637755e-de7e-40c5-8c17-dc57e2c923a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:56.938277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] The token cache is being invalidate because project f9e1c2a46aed47b5b8b0aae8867d56e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:56.938623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:56.939308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:56.940837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 954/1888] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:56 2022] DELETE /identity/v3/projects/f9e1c2a46aed47b5b8b0aae8867d56e9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:56.945005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:56.956812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88993f01-e426-45e6-9710-f103aafc9c48 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:57.015790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:57.016644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:57.017570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:57.017855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] PATH_INFO: `/v3/users/27ccede1e5624b729a8aa6e604b18ba4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:57.019101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ccede1e5624b729a8aa6e604b18ba4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:57.021364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:57.369771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ccede1e5624b729a8aa6e604b18ba4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:57.371125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ccede1e5624b729a8aa6e604b18ba4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:57.382044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ccede1e5624b729a8aa6e604b18ba4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:57.400569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ccede1e5624b729a8aa6e604b18ba4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:57.405848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ccede1e5624b729a8aa6e604b18ba4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:57.515055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 935/1889] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:56 2022] DELETE /identity/v3/users/27ccede1e5624b729a8aa6e604b18ba4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:58.075960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:58.075960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.078612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:58.081736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.109789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637755e-de7e-40c5-8c17-dc57e2c923a1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:58.161991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212383b-6637-43cb-a9ce-21dfaceaca2e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:58.167150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:58.172335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.172335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.172335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] PATH_INFO: `/v3/projects/3d74b120380c45768ef232ff3bc5f85a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.172335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d74b120380c45768ef232ff3bc5f85a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:58.172335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:58.175679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:58.176536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.177046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.177484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] PATH_INFO: `/v3/users/ea7756a3124b4ddea5ef0b33e681481f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.178702 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7756a3124b4ddea5ef0b33e681481f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:58.181700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:58.350233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d74b120380c45768ef232ff3bc5f85a', 'request_id': 'req-32a23806-2bf5-45c6-9fcf-4de2706fd043'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.356431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d74b120380c45768ef232ff3bc5f85a', 'request_id': 'req-32a23806-2bf5-45c6-9fcf-4de2706fd043'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.362570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d74b120380c45768ef232ff3bc5f85a', 'request_id': 'req-32a23806-2bf5-45c6-9fcf-4de2706fd043'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.422527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7756a3124b4ddea5ef0b33e681481f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.464790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] The token cache is being invalidate because project 3d74b120380c45768ef232ff3bc5f85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:58.465174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.466092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.467422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 936/1890] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:58 2022] DELETE /identity/v3/projects/3d74b120380c45768ef232ff3bc5f85a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:58.468357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:58.470386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.503834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7756a3124b4ddea5ef0b33e681481f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.522038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7756a3124b4ddea5ef0b33e681481f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.534546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7756a3124b4ddea5ef0b33e681481f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.535585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b87216ca-05be-44ae-b320-d8626f45a3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7756a3124b4ddea5ef0b33e681481f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.544947 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 955/1891] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:58 2022] DELETE /identity/v3/users/ea7756a3124b4ddea5ef0b33e681481f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:58.547200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd945a4-6009-4b60-b1ef-e56d999128d8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.547913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd945a4-6009-4b60-b1ef-e56d999128d8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.547913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd945a4-6009-4b60-b1ef-e56d999128d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.573900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2dd945a4-6009-4b60-b1ef-e56d999128d8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:58.576056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2dd945a4-6009-4b60-b1ef-e56d999128d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.583021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a23806-2bf5-45c6-9fcf-4de2706fd043 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:58.632161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:58.648506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:58.649154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.649439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.649719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] PATH_INFO: `/v3/users/e06a8508bdb14a79a2a773a217e43a83` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.650855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06a8508bdb14a79a2a773a217e43a83)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:58.652832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:58.657740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 956/1892] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:58.660697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124614f-c921-44c2-a40a-9fa4173f64f1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.662687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124614f-c921-44c2-a40a-9fa4173f64f1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.663963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124614f-c921-44c2-a40a-9fa4173f64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.686388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0124614f-c921-44c2-a40a-9fa4173f64f1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:58.687658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0124614f-c921-44c2-a40a-9fa4173f64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.699683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 957/1893] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:58.699683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.699683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.699683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.716111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:58.739086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:58.740586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.751763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 958/1894] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:47:58.757498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:58.757498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.831246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5c357-1ed8-4526-8d0f-c791794eb91a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:58.835990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:58.837232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.837232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.837561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.849227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:58.850685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:58.863631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 959/1895] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:47:58.865712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:58.879033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0434a22-b3a7-4a7e-9f21-582f91fb9df1 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:58.884422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:58.885114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.885468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.885838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.886759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:47:58.887176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:58.889280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:58.906608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 960/1896] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:47:58.907860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06a8508bdb14a79a2a773a217e43a83'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.908656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06a8508bdb14a79a2a773a217e43a83'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.908771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:58.912971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:58.931556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06a8508bdb14a79a2a773a217e43a83'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.939357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b52a-5fa1-423f-9d50-d927b7d1fdd8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:58.946956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:58.947521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:58.947886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:58.948234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:58.949048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:58.951062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:58.953115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06a8508bdb14a79a2a773a217e43a83'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:58.957733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-eebea54b-7077-42c4-a356-277e420a7081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06a8508bdb14a79a2a773a217e43a83'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:59.104848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 937/1897] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:58 2022] DELETE /identity/v3/users/e06a8508bdb14a79a2a773a217e43a83 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:47:59.109106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.109614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.110093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.112060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 961/1898] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:47:58 2022] POST /identity/v3/projects => generated 361 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:47:59.115998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.139415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:59.142451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.227609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a6a90-953a-449e-a6ea-d0b4002eeb4a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.243094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.244091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.244756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.245160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.249239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 938/1899] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:59.249390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.257983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.259990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.261470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.325118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e0c2d-a19c-4519-a901-f31b9523c4c0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.329320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.330017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.330294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.330600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.341924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.342403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 962/1900] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:47:59 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:47:59.343463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.343592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.354714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97b35-86fc-4a0f-b989-a1d35bca1afd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.355582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 939/1901] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:47:59.365488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.366157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.366157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.366157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.367793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.369369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.383839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 963/1902] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:59.387687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.397698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33b8d-30b1-4294-9e3f-7adbae064b83 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.402659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.403308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.403617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.408417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.408417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.408417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.416760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 940/1903] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:47:59.421135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.431788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dea75-ab1e-4a24-ba4c-5971e19092f7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.436375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29a330-c969-4681-80d0-eb655583d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.437028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a330-c969-4681-80d0-eb655583d624 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.437311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a330-c969-4681-80d0-eb655583d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.437585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a330-c969-4681-80d0-eb655583d624 admin admin] PATH_INFO: `/v3/projects/474d7999790f41e2ab43194b02f4b337/users/1f9679d7274f4884897d953cb2a0c47b/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.452720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29a330-c969-4681-80d0-eb655583d624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474d7999790f41e2ab43194b02f4b337, user_id=1f9679d7274f4884897d953cb2a0c47b, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.455557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29a330-c969-4681-80d0-eb655583d624 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.466356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.468200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.484051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c414b7e-db30-4ecd-a334-2f353e3e0534 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.489967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.490629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.490935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.491210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] PATH_INFO: `/v3/projects/f28bec4bf3604e6eba1c9ec23f11be14` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.492892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28bec4bf3604e6eba1c9ec23f11be14)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.495069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.561854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 964/1904] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:47:59 2022] PUT /identity/v3/projects/474d7999790f41e2ab43194b02f4b337/users/1f9679d7274f4884897d953cb2a0c47b/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:59.573661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.573883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.574158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.602501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] MFA Rules not processed for user `1f9679d7274f4884897d953cb2a0c47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:47:59.603767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.633138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28bec4bf3604e6eba1c9ec23f11be14', 'request_id': 'req-3616a548-15de-4af1-8832-0e27556bd1d4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:59.641302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28bec4bf3604e6eba1c9ec23f11be14', 'request_id': 'req-3616a548-15de-4af1-8832-0e27556bd1d4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:59.647241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28bec4bf3604e6eba1c9ec23f11be14', 'request_id': 'req-3616a548-15de-4af1-8832-0e27556bd1d4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:59.669310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 965/1905] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:47:59.706371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.707931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.772730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] The token cache is being invalidate because project f28bec4bf3604e6eba1c9ec23f11be14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:47:59.773375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:59.774442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:47:59.775026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577931c5-0ebc-4f11-bdf2-7eb83d6136a0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.776296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 941/1906] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:59 2022] DELETE /identity/v3/projects/f28bec4bf3604e6eba1c9ec23f11be14 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:47:59.780212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.781882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.834233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.834854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.835345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.835675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.837689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.881794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a548-15de-4af1-8832-0e27556bd1d4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.890380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.890380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.890380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.890380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] PATH_INFO: `/v3/users/449d590e8f42485a827c33431cb4fcca` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.890740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=449d590e8f42485a827c33431cb4fcca)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.891404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.906707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.908660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:47:59.925781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 966/1907] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:47:59.927425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:47:59.931543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:47:59.951215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd3db-6a20-4826-b8eb-c40ff843fb98 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:47:59.957363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:47:59.958031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:47:59.958314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:47:59.958584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] PATH_INFO: `/v3/projects/e9d95081f28541afb205394eecb13ee4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:47:59.959754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d95081f28541afb205394eecb13ee4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:47:59.961663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:00.102560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449d590e8f42485a827c33431cb4fcca'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.103410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449d590e8f42485a827c33431cb4fcca'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.108192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d95081f28541afb205394eecb13ee4', 'request_id': 'req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.111851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449d590e8f42485a827c33431cb4fcca'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.125140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449d590e8f42485a827c33431cb4fcca'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.126619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449d590e8f42485a827c33431cb4fcca'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.241697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d95081f28541afb205394eecb13ee4', 'request_id': 'req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.253308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d95081f28541afb205394eecb13ee4', 'request_id': 'req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.281040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] The token cache is being invalidate because project e9d95081f28541afb205394eecb13ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:00.281337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.282343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.286039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 967/1908] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:47:59 2022] DELETE /identity/v3/projects/e9d95081f28541afb205394eecb13ee4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:00.287234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:00.291009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:00.306231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 942/1909] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:47:59 2022] DELETE /identity/v3/users/449d590e8f42485a827c33431cb4fcca => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:00.309374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:00.332059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:00.387767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486f8aa-26dd-4ff0-badd-10b2704ae0bc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:00.442241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0169c-0c03-4da1-bf32-047d520be12b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:00.449856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:00.452090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:00.452546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:00.453088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] PATH_INFO: `/v3/users/ed366dd2a4e34b1386ac83b7ee180930` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:00.456177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:00.458096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed366dd2a4e34b1386ac83b7ee180930)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:00.461881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:00.504106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:00.504763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:00.505048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:00.505327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] PATH_INFO: `/v3/users/1f9679d7274f4884897d953cb2a0c47b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:00.506463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9679d7274f4884897d953cb2a0c47b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:00.508443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:00.699978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed366dd2a4e34b1386ac83b7ee180930'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.700852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed366dd2a4e34b1386ac83b7ee180930'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.710481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed366dd2a4e34b1386ac83b7ee180930'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.725576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed366dd2a4e34b1386ac83b7ee180930'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.726498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b28a4a3-b9c7-4f37-9ea1-0760227fe9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed366dd2a4e34b1386ac83b7ee180930'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.761033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9679d7274f4884897d953cb2a0c47b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.835359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 943/1910] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:00 2022] DELETE /identity/v3/users/ed366dd2a4e34b1386ac83b7ee180930 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:00.881218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9679d7274f4884897d953cb2a0c47b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.898713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9679d7274f4884897d953cb2a0c47b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.907006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9679d7274f4884897d953cb2a0c47b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.908495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9679d7274f4884897d953cb2a0c47b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:00.914803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 968/1911] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:00 2022] DELETE /identity/v3/users/1f9679d7274f4884897d953cb2a0c47b => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:00.919249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:00.919611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:00.919891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:00.943735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:00.949331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.005573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 944/1912] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:01.016437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.017973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.050192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.051898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.074117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bbf39-f06b-4684-8670-c145cbad11ad None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.089363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.095494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.095494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.095494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] PATH_INFO: `/v3/projects/335eddc96aab4630a6286a7d32918fb6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.095494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335eddc96aab4630a6286a7d32918fb6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.095494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:01.102421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30efa-ca60-415d-8fc1-122647aadc1e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.106989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d1b20-7807-4fbe-9339-d98bea82e85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.107659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d1b20-7807-4fbe-9339-d98bea82e85c service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.108443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d1b20-7807-4fbe-9339-d98bea82e85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.108733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d1b20-7807-4fbe-9339-d98bea82e85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.119968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d1b20-7807-4fbe-9339-d98bea82e85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.121361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d1b20-7807-4fbe-9339-d98bea82e85c service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:01.136287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 969/1913] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:01.167443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:01.220551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335eddc96aab4630a6286a7d32918fb6', 'request_id': 'req-95459ccd-1914-412f-a291-76dbe9a58922'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.227592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335eddc96aab4630a6286a7d32918fb6', 'request_id': 'req-95459ccd-1914-412f-a291-76dbe9a58922'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.234349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335eddc96aab4630a6286a7d32918fb6', 'request_id': 'req-95459ccd-1914-412f-a291-76dbe9a58922'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.314610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] The token cache is being invalidate because project 335eddc96aab4630a6286a7d32918fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:01.318638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.318638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-95459ccd-1914-412f-a291-76dbe9a58922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.318638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 945/1914] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:01 2022] DELETE /identity/v3/projects/335eddc96aab4630a6286a7d32918fb6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:01.322412 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.322872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.323023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.343367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:01.344694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.416719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 970/1915] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:01.424453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.424818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.425157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.447292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:01.448564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.472954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.478817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 946/1916] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:01.487846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4cab-4170-44a6-a1f0-19fe653f3afe None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.496916 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.501033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.503279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.508027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.508027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.508832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.509599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:01.511643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.520005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:01.558024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 971/1917] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:01.560032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.560658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a07df4-4744-4270-99d9-71178f57b35e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.580358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c083f-3667-4690-8cd8-c437a5411af0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.582141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.588311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.588311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.588311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] PATH_INFO: `/v3/projects/526952d9e4c442baa172e846e363805d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.589862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.590848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=526952d9e4c442baa172e846e363805d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.590981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.592460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.593249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.595763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.598970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:01.600951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:01.716207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 972/1918] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:01 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:01.723871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.799276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526952d9e4c442baa172e846e363805d', 'request_id': 'req-61511293-e0b2-4f1d-9895-212c4484a5ce'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.806889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526952d9e4c442baa172e846e363805d', 'request_id': 'req-61511293-e0b2-4f1d-9895-212c4484a5ce'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.811424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110dbe6-ae9e-4930-b0e4-800b43039728 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.814096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526952d9e4c442baa172e846e363805d', 'request_id': 'req-61511293-e0b2-4f1d-9895-212c4484a5ce'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.881758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:01.884180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.884814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.885094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.885377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.886034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.888013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:01.915699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] The token cache is being invalidate because project 526952d9e4c442baa172e846e363805d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:01.915997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.916754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:01.919039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 947/1919] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:01 2022] DELETE /identity/v3/projects/526952d9e4c442baa172e846e363805d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:01.920835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:01.924123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:01.937787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511293-e0b2-4f1d-9895-212c4484a5ce admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:01.944069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:01.944723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:01.945024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:01.945298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] PATH_INFO: `/v3/projects/474d7999790f41e2ab43194b02f4b337` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:01.946420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474d7999790f41e2ab43194b02f4b337)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:01.948518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.002891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 973/1920] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:01 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:02.003775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.005490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.017928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7033-c27e-4748-8fe6-7fb1758d3a75 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.022716 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.023443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.023727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.023999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] PATH_INFO: `/v3/users/02e71cf6d2e94267ae2e08e0d266c1f2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.025123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e71cf6d2e94267ae2e08e0d266c1f2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.027231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.108196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474d7999790f41e2ab43194b02f4b337', 'request_id': 'req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.116291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474d7999790f41e2ab43194b02f4b337', 'request_id': 'req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.123879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474d7999790f41e2ab43194b02f4b337', 'request_id': 'req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.203177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e71cf6d2e94267ae2e08e0d266c1f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.217999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] The token cache is being invalidate because project 474d7999790f41e2ab43194b02f4b337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:02.218372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.221827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.223024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 948/1921] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:01 2022] DELETE /identity/v3/projects/474d7999790f41e2ab43194b02f4b337 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:02.223844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.225361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.308948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f7d1-df4c-444a-ae1c-b56fdb9b5ac7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.315469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b509ac0-f9df-48b6-aa25-1aec06cd1b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.316108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b509ac0-f9df-48b6-aa25-1aec06cd1b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.316390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b509ac0-f9df-48b6-aa25-1aec06cd1b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.316714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b509ac0-f9df-48b6-aa25-1aec06cd1b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.317406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b509ac0-f9df-48b6-aa25-1aec06cd1b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.319208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b509ac0-f9df-48b6-aa25-1aec06cd1b25 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.331240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 949/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:02.332462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.333336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.333336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.346857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e71cf6d2e94267ae2e08e0d266c1f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.354214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:02.355542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.369487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e71cf6d2e94267ae2e08e0d266c1f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.382404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 950/1923] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:02.383518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.384576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e71cf6d2e94267ae2e08e0d266c1f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.385592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80024e5e-af77-4c4d-a5ea-73819272f608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e71cf6d2e94267ae2e08e0d266c1f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:02.393281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 974/1924] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:02 2022] DELETE /identity/v3/users/02e71cf6d2e94267ae2e08e0d266c1f2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:02.393767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80425fda-008f-427e-a25b-931dbae2f48f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.395543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.396438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.397013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.418975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:02.420635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.461307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.462200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.462634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.463616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.464630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.466611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.480816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 951/1925] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:02.485787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.487813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.504224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e735-5b9a-469c-8078-b1c6b6263201 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.509417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27de1b-422c-4191-8c16-6eb3e3cbc031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.510566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27de1b-422c-4191-8c16-6eb3e3cbc031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.516479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27de1b-422c-4191-8c16-6eb3e3cbc031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.517088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 975/1926] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:02.526354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27de1b-422c-4191-8c16-6eb3e3cbc031 admin admin] PATH_INFO: `/v3/projects/df9328d6ecf34c688c413bc2fd85016e/users/d7ac4c3550924b76ba8cf0be18f80a7f/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.528831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.530259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27de1b-422c-4191-8c16-6eb3e3cbc031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9328d6ecf34c688c413bc2fd85016e, user_id=d7ac4c3550924b76ba8cf0be18f80a7f, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.533188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27de1b-422c-4191-8c16-6eb3e3cbc031 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.540317 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40d69-3c46-42c0-87fd-f3d06bc6c9dd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.544937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:02.547359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.548062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.548345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.548745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.549419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:02.549744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.551431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.565941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 976/1927] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:02.570166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.583538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0eff5-79a3-4cb8-b492-d86e8cff8c3e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.590906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.591493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.591783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.594918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.595739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.597635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.613437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 952/1928] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:02 2022] PUT /identity/v3/projects/df9328d6ecf34c688c413bc2fd85016e/users/d7ac4c3550924b76ba8cf0be18f80a7f/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:02.627134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.627606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.628002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.661112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] MFA Rules not processed for user `d7ac4c3550924b76ba8cf0be18f80a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:02.662469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.717998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 977/1929] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:02 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:48:02.717998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.754239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 953/1930] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:02.770488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.800619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2381f-331b-488b-a380-56c3ed17bd61 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.806269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.806879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.807161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.807460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.808105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.810030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.842253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486e88-5e3b-4304-a2ae-048429a2d54c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.847841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.848542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.848825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.849097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.849743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.851732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.908336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 978/1931] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:02 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:48:02.909692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:02.912534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:02.949185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43325f4-667f-4914-a09b-4cbb22bea639 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:02.952223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:02.953011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:02.953292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:02.953689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] PATH_INFO: `/v3/projects/b5f8d22c99d341ecb1ff43c70669cc54` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:02.955361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f8d22c99d341ecb1ff43c70669cc54)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:02.957319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:02.980316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 954/1932] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:02 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:02.983147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.098544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fd985-731b-40b4-bab6-568d7ef98ae2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.102172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f8d22c99d341ecb1ff43c70669cc54', 'request_id': 'req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:03.156094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.156944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.157845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.158196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.159001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.160961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.178125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 955/1933] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:03.178125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.186800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052878b6-f66e-4bb6-bc5e-b3155835c77c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.193935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5324bc-8da8-4ee5-8426-f3544791334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.194612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5324bc-8da8-4ee5-8426-f3544791334e admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.194898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5324bc-8da8-4ee5-8426-f3544791334e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.195232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5324bc-8da8-4ee5-8426-f3544791334e admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.196774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5324bc-8da8-4ee5-8426-f3544791334e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.198155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f8d22c99d341ecb1ff43c70669cc54', 'request_id': 'req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:03.200389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5324bc-8da8-4ee5-8426-f3544791334e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.206116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f8d22c99d341ecb1ff43c70669cc54', 'request_id': 'req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:03.245972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] The token cache is being invalidate because project b5f8d22c99d341ecb1ff43c70669cc54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:03.246280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:03.247192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:03.248679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 979/1934] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:02 2022] DELETE /identity/v3/projects/b5f8d22c99d341ecb1ff43c70669cc54 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:03.251567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.251816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:03.266249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76384-4af7-4dc5-bfd9-1cd95c634bb8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.271565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2d7ab-8ee8-4ffd-8b5d-ff0f2b44882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.272192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2d7ab-8ee8-4ffd-8b5d-ff0f2b44882b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.272529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2d7ab-8ee8-4ffd-8b5d-ff0f2b44882b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.272815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2d7ab-8ee8-4ffd-8b5d-ff0f2b44882b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.273466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2d7ab-8ee8-4ffd-8b5d-ff0f2b44882b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.275302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2d7ab-8ee8-4ffd-8b5d-ff0f2b44882b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.286142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 980/1935] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:03.287560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.287842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.288142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.308836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:03.310048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:03.332954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 981/1936] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:03.333057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 956/1937] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:03 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:03.333057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.333057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.333057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.333373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.346240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d603-ec77-4938-a017-a7a559fbb725 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.351794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:03.352377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.352846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.352942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.353269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] PATH_INFO: `/v3/projects/5c2768f657b041348e7079a2ac0c1b5b/users/6171a56ade8b47fe95c4ab932bb7e489/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.353405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:03.368435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 957/1938] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:03.370022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.372414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:03.383074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2768f657b041348e7079a2ac0c1b5b, user_id=6171a56ade8b47fe95c4ab932bb7e489, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.386460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.387652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd6b8e-0200-42db-829c-67c01c143b84 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.392777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.393968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.394261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.394543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.397640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.397640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.411686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 958/1939] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:03.412044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.423265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac56fc-3287-4594-8d90-b2af70b34dd7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.428328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.429142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.429536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.429874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.430602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:03.430985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.432768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.451255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 959/1940] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:03.451255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.463657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74099-82fb-4e48-9257-40c32839d30f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.468723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e92539-bf47-4978-9f52-89d3457093bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.470899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92539-bf47-4978-9f52-89d3457093bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.471289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92539-bf47-4978-9f52-89d3457093bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.471703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e92539-bf47-4978-9f52-89d3457093bc admin admin] PATH_INFO: `/v3/projects/286fee8b6ca54b87bd6ec03bc912b7b4/users/34f60dc75f5a4ae5a4142a0a2e572cac/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.495535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e92539-bf47-4978-9f52-89d3457093bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=286fee8b6ca54b87bd6ec03bc912b7b4, user_id=34f60dc75f5a4ae5a4142a0a2e572cac, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.497421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e92539-bf47-4978-9f52-89d3457093bc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.549255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 982/1941] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:03 2022] PUT /identity/v3/projects/5c2768f657b041348e7079a2ac0c1b5b/users/6171a56ade8b47fe95c4ab932bb7e489/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:03.553014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.593090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 960/1942] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:03 2022] PUT /identity/v3/projects/286fee8b6ca54b87bd6ec03bc912b7b4/users/34f60dc75f5a4ae5a4142a0a2e572cac/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:03.600999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.603074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.603605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.638644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:03.641256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:03.672271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98145-728a-4121-8ae0-3bbe2619b0f7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.738912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 961/1943] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:03.742311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.752593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c632d55-bdc8-4b00-a1df-7ebc3284239d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.757771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.758396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.758678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.758957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.759682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.761324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.773729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 962/1944] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:03.776278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.776527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:03.779950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.782585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.783006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.783398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.784176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.786389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.847138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b00d-36a8-4bd4-a77d-9243a02e5031 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.851011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:03.851656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:03.851945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:03.856609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:03.863555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:03.864886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:03.886161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 963/1945] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:03.888570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:03.904640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:03.913772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f63aba-bc18-4449-8dda-70b72cf6139c service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:03.917751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 983/1946] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:03 2022] POST /identity/v3/projects => generated 367 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:03.921606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.008945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8255dd-068d-4051-98db-2ba3cf7ac5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.009757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8255dd-068d-4051-98db-2ba3cf7ac5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.010166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8255dd-068d-4051-98db-2ba3cf7ac5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.010521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8255dd-068d-4051-98db-2ba3cf7ac5d8 admin admin] PATH_INFO: `/v3/projects/286fee8b6ca54b87bd6ec03bc912b7b4/users/34f60dc75f5a4ae5a4142a0a2e572cac/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.013052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8255dd-068d-4051-98db-2ba3cf7ac5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286fee8b6ca54b87bd6ec03bc912b7b4, user_id=34f60dc75f5a4ae5a4142a0a2e572cac, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.016092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8255dd-068d-4051-98db-2ba3cf7ac5d8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.045197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21249d9c-7e2d-441d-a637-ec25d7491a3b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:04.053492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 964/1947] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:03 2022] PUT /identity/v3/projects/286fee8b6ca54b87bd6ec03bc912b7b4/users/34f60dc75f5a4ae5a4142a0a2e572cac/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:04.064950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.065243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.065666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.126183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] MFA Rules not processed for user `34f60dc75f5a4ae5a4142a0a2e572cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:04.128576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:04.165669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.166635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.167065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.167349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.168023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.170272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.275521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 965/1948] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:04.295423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 984/1949] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:03 2022] POST /identity/v3/users => generated 284 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:04.304756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.329396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:04.344225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc96d85-5139-4c22-8376-29cda1242b0d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:04.364203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.364840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.365130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.365462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.366087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.367762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.370400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.375215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:04.389741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 966/1950] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:04.390788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.406433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96bc4-ad26-452a-b580-b8b84e3775f5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:04.412082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.413026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.413417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.413816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.414661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.416588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.447397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 967/1951] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:04.452062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.469448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba1c1-fdff-491e-9fe4-b34d567bbba6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:04.485620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e489e5-5999-40fb-a517-31d86a23c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.486501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e489e5-5999-40fb-a517-31d86a23c580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.490578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e489e5-5999-40fb-a517-31d86a23c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.490578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e489e5-5999-40fb-a517-31d86a23c580 admin admin] PATH_INFO: `/v3/projects/eba54aeaa16844b39811072480b0824e/users/699951cd0cd941618ff52bdeebd4a4d6/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.491714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7f030-5d97-40fd-ae4d-e6e3ed80101a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:04.497694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.498429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.498919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.499277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.501956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:04.524118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e489e5-5999-40fb-a517-31d86a23c580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba54aeaa16844b39811072480b0824e, user_id=699951cd0cd941618ff52bdeebd4a4d6, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.527642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e489e5-5999-40fb-a517-31d86a23c580 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.601457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.604030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.618419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 985/1952] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:04.619282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.621061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:04.638332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8632-c894-45f7-a61f-ce3f305dadca service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:04.643666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:04.644563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.645057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.645568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] PATH_INFO: `/v3/users/2002f1f630714c38ab5b4be2d4a7add4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.646943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2002f1f630714c38ab5b4be2d4a7add4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:04.649248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:04.675451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 968/1953] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:04 2022] PUT /identity/v3/projects/eba54aeaa16844b39811072480b0824e/users/699951cd0cd941618ff52bdeebd4a4d6/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:04.677588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:04.677885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:04.678167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:04.734354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] MFA Rules not processed for user `699951cd0cd941618ff52bdeebd4a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:04.734354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:04.824382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:04.904882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 969/1954] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:04.915161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:04.918041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2002f1f630714c38ab5b4be2d4a7add4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:05.013251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2002f1f630714c38ab5b4be2d4a7add4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:05.052493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2002f1f630714c38ab5b4be2d4a7add4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:05.070733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2002f1f630714c38ab5b4be2d4a7add4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:05.071537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9c5d1cd0-a2a8-46f2-a953-646e1fc531d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2002f1f630714c38ab5b4be2d4a7add4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:05.081307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 986/1955] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:04 2022] DELETE /identity/v3/users/2002f1f630714c38ab5b4be2d4a7add4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:05.085770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:05.086066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:05.091055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:05.091179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db091-6b42-4ff9-86f7-f5231be7dda0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:05.128096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:05.129386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:05.259756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 987/1956] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:05.273053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:05.274633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:05.274819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:05.285665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:05.286432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:05.286865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:05.287913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:05.290290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:05.427194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:05.438842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4d0e-f293-4775-ad8e-267dc7d8a6af None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:05.439553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 970/1957] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:04 2022] POST /identity/v3/projects => generated 367 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:05.441000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:05.445498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:05.543266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:05.544672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:05.544672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:05.544672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:05.597151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c714-460b-4d60-bf51-cc8aca8268cc admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:05.603028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:05.603863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:05.604169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:05.604433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:05.605088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:05.607032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:05.660534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:05.697443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:05.700691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:05.737996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 971/1958] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:05 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:05.742899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:05.747521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 988/1959] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:05.758971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952304c-2136-4eb2-8c26-ee5652982f75 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:05.788558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:05.794341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:05.794955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:05.796388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:05.797105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:05.808810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:05.832993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 972/1960] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:05.838112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:05.853914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e0f1-3171-4f9e-af10-bbd0df7b0a07 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:05.879593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2e830-0892-43f3-9d86-0c23eaeb14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:05.879593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e830-0892-43f3-9d86-0c23eaeb14a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:05.879593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e830-0892-43f3-9d86-0c23eaeb14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:05.879593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e830-0892-43f3-9d86-0c23eaeb14a4 admin admin] PATH_INFO: `/v3/projects/6897711768604a55b06c9581a9922e60/users/6a59933e2bc04714a4eec621add5a4bc/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:05.900773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2e830-0892-43f3-9d86-0c23eaeb14a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6897711768604a55b06c9581a9922e60, user_id=6a59933e2bc04714a4eec621add5a4bc, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:05.904954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2e830-0892-43f3-9d86-0c23eaeb14a4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:06.038825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 989/1961] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:05 2022] PUT /identity/v3/projects/6897711768604a55b06c9581a9922e60/users/6a59933e2bc04714a4eec621add5a4bc/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:06.042750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:06.062766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247afcb-605c-4aef-b143-95648445ba82 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:06.156775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.157578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.157946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.227793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:06.228366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.228652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.228935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.229597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:06.231223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:06.232422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] MFA Rules not processed for user `6171a56ade8b47fe95c4ab932bb7e489`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:06.233682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:06.255091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 973/1962] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:06.258836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:06.272581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5730-5550-4a81-8f4b-96f146be6e80 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:06.278598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e1d49-3195-4079-9eb8-d6a13c062c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:06.279530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1d49-3195-4079-9eb8-d6a13c062c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.279717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1d49-3195-4079-9eb8-d6a13c062c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.279994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1d49-3195-4079-9eb8-d6a13c062c9f admin admin] PATH_INFO: `/v3/projects/6897711768604a55b06c9581a9922e60/users/6a59933e2bc04714a4eec621add5a4bc/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.282730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e1d49-3195-4079-9eb8-d6a13c062c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6897711768604a55b06c9581a9922e60, user_id=6a59933e2bc04714a4eec621add5a4bc, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:06.285686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e1d49-3195-4079-9eb8-d6a13c062c9f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:06.301447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 974/1963] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:06 2022] PUT /identity/v3/projects/6897711768604a55b06c9581a9922e60/users/6a59933e2bc04714a4eec621add5a4bc/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:06.311904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.312202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.316151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.377089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] MFA Rules not processed for user `6a59933e2bc04714a4eec621add5a4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:06.383612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:06.410256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 990/1964] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:06.426404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:06.428751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:06.562354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 975/1965] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:06.566108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:06.566883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581887ab-5add-4545-ae66-b013fbbfe44f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:06.571403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:06.656368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec677c27-2dc0-474a-9e5b-5f49eb272f97 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:06.661610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:06.662695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.663079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.663802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.665241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:06.666072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.666695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.667229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] PATH_INFO: `/v3/projects/50c13a127aee494cbaefd80eadae8a88` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.668698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c13a127aee494cbaefd80eadae8a88)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:06.671834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:06.749850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:06.752783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:06.770889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 991/1966] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:06.770889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:06.772084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:06.794810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411a798-f02b-4a04-a6e5-3593ea256a89 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:06.817815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c13a127aee494cbaefd80eadae8a88', 'request_id': 'req-4b1bad8b-7a73-42cc-8334-08e09795af43'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:06.828289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c13a127aee494cbaefd80eadae8a88', 'request_id': 'req-4b1bad8b-7a73-42cc-8334-08e09795af43'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:06.841952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c13a127aee494cbaefd80eadae8a88', 'request_id': 'req-4b1bad8b-7a73-42cc-8334-08e09795af43'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:06.903969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:06.905065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:06.905556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:06.906055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:06.926669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] The token cache is being invalidate because project 50c13a127aee494cbaefd80eadae8a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:06.926986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:06.927688 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:06.934670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 976/1967] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:06 2022] DELETE /identity/v3/projects/50c13a127aee494cbaefd80eadae8a88 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:06.940204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:06.942494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:07.038268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:07.047805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:07.058879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 992/1968] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:07.107746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bad8b-7a73-42cc-8334-08e09795af43 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:07.116379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:07.117187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:07.117519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:07.117858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] PATH_INFO: `/v3/users/4f5d4c30a6d54db188282df3bb46e0c8` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:07.119019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5d4c30a6d54db188282df3bb46e0c8)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:07.124656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:07.406703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5d4c30a6d54db188282df3bb46e0c8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:07.408288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5d4c30a6d54db188282df3bb46e0c8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:07.416331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5d4c30a6d54db188282df3bb46e0c8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:07.429392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5d4c30a6d54db188282df3bb46e0c8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:07.430301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5d4c30a6d54db188282df3bb46e0c8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:07.444283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:07.447817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:07.459149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef6fa-98b5-4ec1-812a-6b61edd37562 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:07.459149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:07.459149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:07.459149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:07.459901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:07.460637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:07.521134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 977/1969] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:06 2022] DELETE /identity/v3/users/4f5d4c30a6d54db188282df3bb46e0c8 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:07.539197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:07.541331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db9801-6870-41f8-98d7-3f06d9cc5f8d service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:07.554226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 993/1970] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:07.991040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:09.040638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:09.042283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:09.141922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475bc9c-482f-4aa3-b144-1186080928cd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:09.141922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:09.141922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:09.141922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:09.142274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] PATH_INFO: `/v3/projects/5af97ed349ae49c09976ff81930efa94` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:09.142274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af97ed349ae49c09976ff81930efa94)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:09.142274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:09.261208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af97ed349ae49c09976ff81930efa94', 'request_id': 'req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:09.267726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af97ed349ae49c09976ff81930efa94', 'request_id': 'req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:09.273333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af97ed349ae49c09976ff81930efa94', 'request_id': 'req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:09.321210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:09.366777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] The token cache is being invalidate because project 5af97ed349ae49c09976ff81930efa94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:09.367338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:09.368188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a2bd4cf4-8f25-403e-9d92-1fc74d270c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:09.387865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 978/1971] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:09 2022] DELETE /identity/v3/projects/5af97ed349ae49c09976ff81930efa94 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:09.393010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1cc5-8ba7-4cad-b982-7ba5646bfb9b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:09.393314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1cc5-8ba7-4cad-b982-7ba5646bfb9b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:09.393571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1cc5-8ba7-4cad-b982-7ba5646bfb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:09.421518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-675e1cc5-8ba7-4cad-b982-7ba5646bfb9b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:09.423788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-675e1cc5-8ba7-4cad-b982-7ba5646bfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:09.469856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:09.490125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ab68-0844-402e-85be-30192362d8cb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:09.490412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ab68-0844-402e-85be-30192362d8cb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:09.490691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926ab68-0844-402e-85be-30192362d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:09.521305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b926ab68-0844-402e-85be-30192362d8cb None None] MFA Rules not processed for user `6171a56ade8b47fe95c4ab932bb7e489`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:09.529161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b926ab68-0844-402e-85be-30192362d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:09.568735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 994/1972] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:09.579614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:09.579949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:09.580301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:09.635541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:09.636973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:09.657369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 979/1973] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:09.674620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 995/1974] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:09.678910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ab68-0844-402e-85be-30192362d8cb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:09.691218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926ab68-0844-402e-85be-30192362d8cb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:09.696014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:09.696670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:09.696963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:09.697778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:09.698429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:09.698859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:09.701742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:09.718865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 980/1975] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:09.724467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:09.734559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680357b-e811-4ff1-aa3b-dec10dcaa46a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:09.771973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:09.777515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:09.783225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:09.783225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:09.783225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:09.784724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:09.945632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 996/1976] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:09 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:09.950228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:09.963965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6cf6e-89c2-4488-a977-944726739ea0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.044803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.045430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.045666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.045943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.047618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:10.050538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:10.136544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 981/1977] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:09 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:10.140410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:10.153335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87785df-d9e2-4ce1-b409-6972e73d32fe admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.161980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.162658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.162940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.163220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.163937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:10.166530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:10.183524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 997/1978] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:10.184794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:10.196249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40f62-117d-48a5-a97e-6bbc27810fed admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.201674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ecc1-75d7-4b52-9c01-fb10d911fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.202293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ecc1-75d7-4b52-9c01-fb10d911fbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.202577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ecc1-75d7-4b52-9c01-fb10d911fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.202852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ecc1-75d7-4b52-9c01-fb10d911fbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.203983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ecc1-75d7-4b52-9c01-fb10d911fbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:10.207332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ecc1-75d7-4b52-9c01-fb10d911fbb5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:10.218006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 982/1979] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:10.222254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:10.232290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6c9b7-443e-4341-ae39-74e76c275f11 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.242848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.243680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.243967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.244249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] PATH_INFO: `/v3/projects/d7f4798e9cfa461d80e69115824c0407/users/3858fc73f34b45c9b2c51d974d8b8a00/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.280900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f4798e9cfa461d80e69115824c0407, user_id=3858fc73f34b45c9b2c51d974d8b8a00, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:10.283988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:10.378614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 998/1980] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:10 2022] PUT /identity/v3/projects/d7f4798e9cfa461d80e69115824c0407/users/3858fc73f34b45c9b2c51d974d8b8a00/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:10.391891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.392192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.392495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.424345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] MFA Rules not processed for user `3858fc73f34b45c9b2c51d974d8b8a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:10.440941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:10.614570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 983/1981] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:10.615784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:10.710469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8665e3e-c598-4576-bad7-e2c82ba81951 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.716868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.717674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.718090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.718508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.719942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:10.722644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:10.808793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 999/1982] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:10 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:10.812702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:10.826643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699b8c-998b-48b9-bbdb-12d055976cd1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.883124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.883804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.884088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.884359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:10.885006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:10.887839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:10.903846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:10.977836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 984/1983] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:10 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:10.981713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:10.992724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b32f6-e115-497f-bb28-9cca167504e8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:10.997320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:10.997922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:10.998203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:10.998478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.001484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:11.004342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:11.006074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:11.021443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1000/1984] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:11.022351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:11.035526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816e9d-fd70-41e1-9012-cb76ea52d588 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:11.040904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:11.041579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:11.043872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:11.043872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] PATH_INFO: `/v3/projects/5c9e65f40bb34412b94e53b2bf20c836/users/5059321b4eca4fea913ed8a14dbe6d6b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.058993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9e65f40bb34412b94e53b2bf20c836, user_id=5059321b4eca4fea913ed8a14dbe6d6b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:11.061597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:11.207294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 985/1985] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:11 2022] PUT /identity/v3/projects/5c9e65f40bb34412b94e53b2bf20c836/users/5059321b4eca4fea913ed8a14dbe6d6b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:11.211642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:11.222632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc3607-d67b-42f0-914e-bbca87066665 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:11.285399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784bb4-b668-4b94-8d8f-9f49ed9f03b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:11.285979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784bb4-b668-4b94-8d8f-9f49ed9f03b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:11.286262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784bb4-b668-4b94-8d8f-9f49ed9f03b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:11.286536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784bb4-b668-4b94-8d8f-9f49ed9f03b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.287179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784bb4-b668-4b94-8d8f-9f49ed9f03b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:11.288868 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784bb4-b668-4b94-8d8f-9f49ed9f03b1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:11.300581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1001/1986] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:11.304430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:11.315724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5947c3-3605-4abd-a90d-22353f6939a2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:11.320958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:11.321891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:11.322416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:11.322789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] PATH_INFO: `/v3/projects/5c9e65f40bb34412b94e53b2bf20c836/users/5059321b4eca4fea913ed8a14dbe6d6b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.324995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9e65f40bb34412b94e53b2bf20c836, user_id=5059321b4eca4fea913ed8a14dbe6d6b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:11.328240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:11.340337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 986/1987] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:11 2022] PUT /identity/v3/projects/5c9e65f40bb34412b94e53b2bf20c836/users/5059321b4eca4fea913ed8a14dbe6d6b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:11.354778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85060a85-27d6-44ef-8706-a353a539439c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:11.354778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85060a85-27d6-44ef-8706-a353a539439c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:11.355030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85060a85-27d6-44ef-8706-a353a539439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.389600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-85060a85-27d6-44ef-8706-a353a539439c None None] MFA Rules not processed for user `5059321b4eca4fea913ed8a14dbe6d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:11.390177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-85060a85-27d6-44ef-8706-a353a539439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:11.497657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1002/1988] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:11.509034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:11.510808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:11.580551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf11a-8baf-46cc-8cde-ba766ee6fa2e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:11.584415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:11.585006 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:11.585312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:11.585566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.595958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:11.597471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:11.607976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 987/1989] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:11.620752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85060a85-27d6-44ef-8706-a353a539439c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:11.622176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-85060a85-27d6-44ef-8706-a353a539439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:11.636620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85060a85-27d6-44ef-8706-a353a539439c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:11.641244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:11.641993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:11.642347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:11.646426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:11.647654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:11.714979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:11.716474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476b5a7-5126-4e1b-a35f-e9c8d17d54ac service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:11.727243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1003/1990] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:12.332228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:12.377802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:13.091230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:13.452585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:13.530348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b902c67-5043-47dd-8d13-cb6c1596284e service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:13.537141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:13.537443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:13.537995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:13.538280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] PATH_INFO: `/v3/users/3858fc73f34b45c9b2c51d974d8b8a00` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:13.539640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3858fc73f34b45c9b2c51d974d8b8a00)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:13.541609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:13.660043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:13.734995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3858fc73f34b45c9b2c51d974d8b8a00'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:13.736089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3858fc73f34b45c9b2c51d974d8b8a00'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:13.743478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3858fc73f34b45c9b2c51d974d8b8a00'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:13.756623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3858fc73f34b45c9b2c51d974d8b8a00'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:13.757353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3858fc73f34b45c9b2c51d974d8b8a00'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:13.856315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 988/1991] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:13 2022] DELETE /identity/v3/users/3858fc73f34b45c9b2c51d974d8b8a00 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:13.861085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:13.861589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:13.862041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:13.897287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:13.898542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:13.997439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1004/1992] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:14.008578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:14.010108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:14.072825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05f15-76ca-42fb-b5fa-593fd283f6b3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:14.079416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:14.079416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:14.079416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:14.079783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:14.092648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:14.096470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:14.106049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 989/1993] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:14.332253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:14.685257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:14.686759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:14.711010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a66a6-e6be-47eb-a755-286c1ef00618 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:14.717206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:14.717846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:14.718127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:14.718403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] PATH_INFO: `/v3/projects/d7f4798e9cfa461d80e69115824c0407` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:14.719905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f4798e9cfa461d80e69115824c0407)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:14.722486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:14.837067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f4798e9cfa461d80e69115824c0407', 'request_id': 'req-7c2d4ead-d326-468f-b8c2-98644a229c3c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:14.901809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f4798e9cfa461d80e69115824c0407', 'request_id': 'req-7c2d4ead-d326-468f-b8c2-98644a229c3c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:14.909081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f4798e9cfa461d80e69115824c0407', 'request_id': 'req-7c2d4ead-d326-468f-b8c2-98644a229c3c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:14.923516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] The token cache is being invalidate because project d7f4798e9cfa461d80e69115824c0407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:14.923855 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:14.924495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:14.926374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1005/1994] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:14 2022] DELETE /identity/v3/projects/d7f4798e9cfa461d80e69115824c0407 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:14.930562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:14.942507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a24304-083a-4deb-ae9e-7101c788397e service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:15.012853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:15.013851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:15.014118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:15.014583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] PATH_INFO: `/v3/users/5059321b4eca4fea913ed8a14dbe6d6b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:15.016238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5059321b4eca4fea913ed8a14dbe6d6b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:15.018425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:15.121246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:15.289473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5059321b4eca4fea913ed8a14dbe6d6b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:15.290163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5059321b4eca4fea913ed8a14dbe6d6b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:15.297951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5059321b4eca4fea913ed8a14dbe6d6b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:15.310096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5059321b4eca4fea913ed8a14dbe6d6b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:15.310846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5059321b4eca4fea913ed8a14dbe6d6b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:15.400395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 990/1995] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:14 2022] DELETE /identity/v3/users/5059321b4eca4fea913ed8a14dbe6d6b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:15.777819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:15.832298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:15.833795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:15.848654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4ead-d326-468f-b8c2-98644a229c3c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:15.911183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:15.911877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:15.912156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:15.912428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] PATH_INFO: `/v3/users/699951cd0cd941618ff52bdeebd4a4d6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:15.913574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] RBAC: Authorizing `identity:delete_user(user_id=699951cd0cd941618ff52bdeebd4a4d6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:15.915567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:15.949142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:15.992076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:15.993576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:16.008181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621cec-38a6-44f4-a208-7f62c362b037 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.027134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.028689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.028886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.029502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] PATH_INFO: `/v3/projects/5c9e65f40bb34412b94e53b2bf20c836` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.030727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9e65f40bb34412b94e53b2bf20c836)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.033152 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.122987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699951cd0cd941618ff52bdeebd4a4d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.158421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9e65f40bb34412b94e53b2bf20c836', 'request_id': 'req-8cdf118f-dd9a-415f-8955-89636ea02b67'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.167840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9e65f40bb34412b94e53b2bf20c836', 'request_id': 'req-8cdf118f-dd9a-415f-8955-89636ea02b67'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.177298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9e65f40bb34412b94e53b2bf20c836', 'request_id': 'req-8cdf118f-dd9a-415f-8955-89636ea02b67'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.206198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699951cd0cd941618ff52bdeebd4a4d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.221718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699951cd0cd941618ff52bdeebd4a4d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.230456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699951cd0cd941618ff52bdeebd4a4d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.231200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-80a97516-8be6-44b3-a3d1-1c78ecebb50e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699951cd0cd941618ff52bdeebd4a4d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.238829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1006/1996] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:15 2022] DELETE /identity/v3/users/699951cd0cd941618ff52bdeebd4a4d6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:16.243542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.243841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.244786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.267269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:16.268531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:16.287535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] The token cache is being invalidate because project 5c9e65f40bb34412b94e53b2bf20c836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:16.288136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.289678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8cdf118f-dd9a-415f-8955-89636ea02b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:16.292876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 991/1997] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:15 2022] DELETE /identity/v3/projects/5c9e65f40bb34412b94e53b2bf20c836 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:16.298233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5b02-ea04-4bfa-8078-44c544dae25e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.298995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5b02-ea04-4bfa-8078-44c544dae25e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.299582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5b02-ea04-4bfa-8078-44c544dae25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.328886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-943e5b02-ea04-4bfa-8078-44c544dae25e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:16.330473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-943e5b02-ea04-4bfa-8078-44c544dae25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:16.336814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1007/1998] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:16.354382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.356453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:16.361742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 992/1999] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:16.376325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.376858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.377328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.402902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:16.404398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:16.421699 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 993/2000] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:16.424307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.437047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd0cdb-66cb-4662-9ea3-9d02e5ef8237 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.441669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.442701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.443150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.443618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.448548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012d43-9e90-4c72-a720-b74f29fa3755 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.455498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.455874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.456913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.457309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.457704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.457941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.459099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:16.459546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.461415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.471288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1008/2001] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:16.482112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 994/2002] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:16.483507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.495246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4077d6-16a1-4ce5-9cbf-5d7e89288636 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.504498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.505297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.505686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.506064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.506836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.509051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.621594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 995/2003] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:16 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:16.623027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.633203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ef2b-2fed-403a-88a7-f6e5fe9fb188 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.693308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.693993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.695097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.695097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.696007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.697922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:16.700743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.791417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1009/2004] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:16 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:16.795579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.823270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4e67-d8c9-48c7-9b63-cc150d9f1adf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.834596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.834596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.834596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.834596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.847251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.852299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.882604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 996/2005] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:16.884214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.886363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:16.897818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651e8fc-9d24-4d0b-bbe1-bf6d5fd08f81 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.903728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.904360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.904645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.904919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.905631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.908300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:16.936669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1010/2006] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:16.940907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:16.951702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498466d-4875-4664-a78b-aeaae62e61ea admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:16.958346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb904c-1da3-4082-95ed-725f297aa1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:16.959014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb904c-1da3-4082-95ed-725f297aa1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:16.960015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb904c-1da3-4082-95ed-725f297aa1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:16.960429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb904c-1da3-4082-95ed-725f297aa1ee admin admin] PATH_INFO: `/v3/projects/2c0f8b42147c4af0a9243a7be1377b56/users/a1c75017265f4e8399af9781d62df9de/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:16.982153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb904c-1da3-4082-95ed-725f297aa1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0f8b42147c4af0a9243a7be1377b56, user_id=a1c75017265f4e8399af9781d62df9de, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:16.987070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb904c-1da3-4082-95ed-725f297aa1ee admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:17.045062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:17.047876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:17.068003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee117-440c-4abd-9363-d5325273b5d7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:17.073689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:17.074638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:17.074976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:17.075478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] PATH_INFO: `/v3/projects/eba54aeaa16844b39811072480b0824e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:17.076955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba54aeaa16844b39811072480b0824e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:17.079234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:17.116505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 997/2007] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:16 2022] PUT /identity/v3/projects/2c0f8b42147c4af0a9243a7be1377b56/users/a1c75017265f4e8399af9781d62df9de/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:17.118432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:17.118721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:17.119172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:17.160351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] MFA Rules not processed for user `a1c75017265f4e8399af9781d62df9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:17.161850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:17.241237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 998/2008] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:17.254033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:17.255633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:17.257742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba54aeaa16844b39811072480b0824e', 'request_id': 'req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.314948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64f3c7-7d8f-4044-b1ca-bbc34b137457 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:17.374383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:17.375713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:17.375936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:17.376295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:17.384785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba54aeaa16844b39811072480b0824e', 'request_id': 'req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.396395 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba54aeaa16844b39811072480b0824e', 'request_id': 'req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.411101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] The token cache is being invalidate because project eba54aeaa16844b39811072480b0824e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:17.411319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.412023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.413690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1011/2009] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:17 2022] DELETE /identity/v3/projects/eba54aeaa16844b39811072480b0824e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:17.417770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:17.419457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:17.478981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:17.479920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:17.500149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 999/2010] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:17.524744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:17.534760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7a9f0-f1d7-4e0a-911e-fdc4162f5bbf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:17.536273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39985dfb-0bb0-42a9-9ee5-5f1e9e8703b6 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:17.541930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:17.542112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:17.542687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:17.543239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:17.543239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] PATH_INFO: `/v3/users/a1c75017265f4e8399af9781d62df9de` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:17.543718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:17.544012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:17.544335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] PATH_INFO: `/v3/users/6a59933e2bc04714a4eec621add5a4bc` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:17.544724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c75017265f4e8399af9781d62df9de)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:17.545554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a59933e2bc04714a4eec621add5a4bc)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:17.546800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:17.548228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:17.776970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a59933e2bc04714a4eec621add5a4bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.789017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c75017265f4e8399af9781d62df9de'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.789855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c75017265f4e8399af9781d62df9de'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.797759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c75017265f4e8399af9781d62df9de'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.812707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c75017265f4e8399af9781d62df9de'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.813474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c75017265f4e8399af9781d62df9de'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.856159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a59933e2bc04714a4eec621add5a4bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.869036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a59933e2bc04714a4eec621add5a4bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.876167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a59933e2bc04714a4eec621add5a4bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.876887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9cbf4bfe-978f-4105-81f6-e92ee94efce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a59933e2bc04714a4eec621add5a4bc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:17.883093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1012/2011] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:17 2022] DELETE /identity/v3/users/6a59933e2bc04714a4eec621add5a4bc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:17.946116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:17.954687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1000/2012] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:17 2022] DELETE /identity/v3/users/a1c75017265f4e8399af9781d62df9de => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:17.959986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:17.960483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:17.961187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:17.987274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:17.988847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:18.083745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1013/2013] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:18.094463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:18.096371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:18.168197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e1aba-a323-42cd-8c71-f32731aaaabf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:18.173409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d79777-e93f-4a90-aae5-e44273e84ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:18.174123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79777-e93f-4a90-aae5-e44273e84ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:18.174414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79777-e93f-4a90-aae5-e44273e84ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:18.174721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d79777-e93f-4a90-aae5-e44273e84ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:18.178647 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:18.185321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79777-e93f-4a90-aae5-e44273e84ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:18.186879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d79777-e93f-4a90-aae5-e44273e84ec8 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:18.198836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1001/2014] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:18.231260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:18.231260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:18.245149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45d60e-696b-4f04-8d95-d266e08dfabb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:18.252206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:18.253339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:18.254050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:18.254517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] PATH_INFO: `/v3/users/d7ac4c3550924b76ba8cf0be18f80a7f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:18.256393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ac4c3550924b76ba8cf0be18f80a7f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:18.259289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:18.760846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ac4c3550924b76ba8cf0be18f80a7f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:18.846156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ac4c3550924b76ba8cf0be18f80a7f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:18.869710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ac4c3550924b76ba8cf0be18f80a7f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:18.879343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ac4c3550924b76ba8cf0be18f80a7f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:18.880869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ac4c3550924b76ba8cf0be18f80a7f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:18.886241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1014/2015] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:18 2022] DELETE /identity/v3/users/d7ac4c3550924b76ba8cf0be18f80a7f => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:18.890507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:18.890900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:18.891265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:18.911740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:18.913184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:18.917939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:18.919223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:18.956247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:18.989399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:19.028574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1002/2016] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:19.029539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.036108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.046711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9548bb-5f83-4cdc-b5d6-4e156bb7bd09 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.051997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.052599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.052886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.053161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] PATH_INFO: `/v3/projects/6897711768604a55b06c9581a9922e60` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.054360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6897711768604a55b06c9581a9922e60)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.070686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.071142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7154cda-8a89-4272-8b6f-8edd0c873524 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.071142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.071142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.071142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.071843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] PATH_INFO: `/v3/projects/2c0f8b42147c4af0a9243a7be1377b56` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.072335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0f8b42147c4af0a9243a7be1377b56)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.074953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.201079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6897711768604a55b06c9581a9922e60', 'request_id': 'req-83b70749-c16d-44de-9911-5bec07afac61'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.208711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6897711768604a55b06c9581a9922e60', 'request_id': 'req-83b70749-c16d-44de-9911-5bec07afac61'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.214567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6897711768604a55b06c9581a9922e60', 'request_id': 'req-83b70749-c16d-44de-9911-5bec07afac61'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.229158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0f8b42147c4af0a9243a7be1377b56', 'request_id': 'req-9977b87e-47c3-4016-b749-8107ccb96ec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.309823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:19.309922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] The token cache is being invalidate because project 6897711768604a55b06c9581a9922e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:19.309922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.310959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.313890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1003/2017] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:19 2022] DELETE /identity/v3/projects/6897711768604a55b06c9581a9922e60 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:19.314843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.317968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.385752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70749-c16d-44de-9911-5bec07afac61 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.410204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0f8b42147c4af0a9243a7be1377b56', 'request_id': 'req-9977b87e-47c3-4016-b749-8107ccb96ec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.416686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0f8b42147c4af0a9243a7be1377b56', 'request_id': 'req-9977b87e-47c3-4016-b749-8107ccb96ec5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.439508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] The token cache is being invalidate because project 2c0f8b42147c4af0a9243a7be1377b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:19.439834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.440834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-9977b87e-47c3-4016-b749-8107ccb96ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:19.442387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1015/2018] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:18 2022] DELETE /identity/v3/projects/2c0f8b42147c4af0a9243a7be1377b56 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:19.443837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9d15a-833b-4ef8-aab9-9f295fff30ef None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.447148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9d15a-833b-4ef8-aab9-9f295fff30ef None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.447148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9d15a-833b-4ef8-aab9-9f295fff30ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.447331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.447331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.447331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.447331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.448962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.471605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-02d9d15a-833b-4ef8-aab9-9f295fff30ef None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:19.472907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-02d9d15a-833b-4ef8-aab9-9f295fff30ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.483111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:19.503624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:19.539667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.541131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5466b-46da-41e3-b6b4-ea9710e1a829 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.543693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1016/2019] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:19.545241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae13d-1207-4304-b63a-cf3c3111dbef None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.545747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae13d-1207-4304-b63a-cf3c3111dbef None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.546248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ae13d-1207-4304-b63a-cf3c3111dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.554513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1004/2020] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:19.555919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.556228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.556713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.576735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e58ae13d-1207-4304-b63a-cf3c3111dbef None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:19.578133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e58ae13d-1207-4304-b63a-cf3c3111dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.584273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:19.585627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.591046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1017/2021] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:19.599538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.600523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.602688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.603356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1005/2022] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:19.607236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.619194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4445248-f5e2-4882-983f-f65306b4c82b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.624354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.627873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.627873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.627873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.627873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:19.627873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.628348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.636677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:19.638062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:19.641936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1006/2023] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:19.645612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.648511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1018/2024] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:19.658524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b09af-cab3-4695-8341-f2d106cda4b6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.660703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.670952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.678029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.686889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.686889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.686889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.687549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d7ddf-08b7-4159-aaa9-5ddafce4cb00 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.687774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.703253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.704181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.704470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.704755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.705473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:19.705787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.712075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.739676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1019/2025] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:19.742700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.756529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562e417-ef45-484a-b58e-ceffcdb7e388 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.763744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.766282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.766282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.766282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.766638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.770776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.800079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1007/2026] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:19.803336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.888630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716144f-6ed8-4ca8-812c-87b2e794938c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:19.896330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:19.901143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:19.901143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:19.901143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:19.901143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:19.901727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1020/2027] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:19.904344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:19.906529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:19.991108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1008/2028] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:48:19.995791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.010468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47d20e-56be-4291-88db-58c5eae27ab5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.024309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.024309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.024309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.024309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.024827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.024827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.025186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6f21-7736-413c-bcef-fbbecd4923d8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.037652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.038724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.039016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.039299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.039988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.041603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.061076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1009/2029] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:20.063468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.081515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a51c30-464d-44f4-a5b2-d75810d91c02 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.102182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.102970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.103208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.103473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.104132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.105812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.128505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1021/2030] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:19 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:20.132627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.137040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1010/2031] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:20.138815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.154849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70313-280a-4ab8-8bcd-6322f4712e8f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.155362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7ec8-5664-4ba3-89ce-67994b662e73 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.161163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2b17-06f9-4a61-a1e1-ff3befb4e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.162032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.162202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2b17-06f9-4a61-a1e1-ff3befb4e946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.162557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2b17-06f9-4a61-a1e1-ff3befb4e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.162748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.163108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2b17-06f9-4a61-a1e1-ff3befb4e946 admin admin] PATH_INFO: `/v3/projects/7a7d12d12c1d4bc69d0c3693814e7280/users/a5bbb67e431b48c2a9eed217a5235cb3/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.163598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.164035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.164989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.166845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.179274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1022/2032] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:20.183009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.185871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2b17-06f9-4a61-a1e1-ff3befb4e946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7d12d12c1d4bc69d0c3693814e7280, user_id=a5bbb67e431b48c2a9eed217a5235cb3, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.193331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2b17-06f9-4a61-a1e1-ff3befb4e946 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.195533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7bcf0-84ce-4ccd-97c3-7af68b2782de admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.200364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.201071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.201618 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.201891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.202554 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.205105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.212066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:20.217440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1023/2033] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:20.222274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.231588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91fa95-3396-4094-bff9-41e23f811ecf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.236245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.237049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.237166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.237438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] PATH_INFO: `/v3/projects/b519bd21555f4b0aaf29beab1573490f/users/6d51ba6e485e4be59e5a5a482afd7152/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.252024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b519bd21555f4b0aaf29beab1573490f, user_id=6d51ba6e485e4be59e5a5a482afd7152, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.254642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.331848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1011/2034] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:20 2022] PUT /identity/v3/projects/7a7d12d12c1d4bc69d0c3693814e7280/users/a5bbb67e431b48c2a9eed217a5235cb3/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:20.337001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2aeef-b03a-47a3-ba01-64a6dab2b48b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.337294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2aeef-b03a-47a3-ba01-64a6dab2b48b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.337575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2aeef-b03a-47a3-ba01-64a6dab2b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.366361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1024/2035] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:20 2022] PUT /identity/v3/projects/b519bd21555f4b0aaf29beab1573490f/users/6d51ba6e485e4be59e5a5a482afd7152/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:20.368777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.376543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.390750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-25b2aeef-b03a-47a3-ba01-64a6dab2b48b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:20.392044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-25b2aeef-b03a-47a3-ba01-64a6dab2b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.450251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4ff3-b891-4a53-bbef-921143e9456c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.462061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1012/2036] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:20.462061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.462061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.462061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.467224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.469507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.469507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.469507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] PATH_INFO: `/v3/projects/df9328d6ecf34c688c413bc2fd85016e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.471121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9328d6ecf34c688c413bc2fd85016e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.472424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.487985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:20.495696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] MFA Rules not processed for user `6d51ba6e485e4be59e5a5a482afd7152`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:20.497030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.564988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1013/2037] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:20.564988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.566298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.582323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9328d6ecf34c688c413bc2fd85016e', 'request_id': 'req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:20.633733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef84fa5-1242-4830-8cd5-28a303512fb2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.640178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9328d6ecf34c688c413bc2fd85016e', 'request_id': 'req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:20.646278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9328d6ecf34c688c413bc2fd85016e', 'request_id': 'req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:20.657648 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] The token cache is being invalidate because project df9328d6ecf34c688c413bc2fd85016e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:20.657938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:20.658601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73a959c8-1d53-47d9-87b1-8c0f8215d2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:20.660337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1025/2038] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:20 2022] DELETE /identity/v3/projects/df9328d6ecf34c688c413bc2fd85016e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:20.661323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9eb65-d0f6-48cb-bb6c-97e16c7e7bf6 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.661592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9eb65-d0f6-48cb-bb6c-97e16c7e7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.661862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9eb65-d0f6-48cb-bb6c-97e16c7e7bf6 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.663199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1026/2039] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:48:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:48:20.663821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9eb65-d0f6-48cb-bb6c-97e16c7e7bf6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.665510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e9a9eb65-d0f6-48cb-bb6c-97e16c7e7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.685508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.686133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.686419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.686747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.689687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.758530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9eb65-d0f6-48cb-bb6c-97e16c7e7bf6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.760492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.762002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.765755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.765755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.765755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.765755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.766188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.772700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1014/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:20.773534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.774925 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.787751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd69c7-844d-4e14-838c-59d634d87ee1 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:20.794743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:20.795461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.795712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.798603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] PATH_INFO: `/v3/users/34f60dc75f5a4ae5a4142a0a2e572cac` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.800114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f60dc75f5a4ae5a4142a0a2e572cac)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.802041 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.823642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:20.840318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:20.841932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd6c83-4f57-4e12-aacd-c6a453c15439 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:20.851428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1027/2041] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:20.852679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:20.852962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:20.853235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:20.873046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:20.874305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:20.967131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1028/2042] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:20.973447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:20.982322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:21.009837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a6d0-e0b5-41a3-9b13-b236c0ecd3ee None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:21.011444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:21.012180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:21.012744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:21.013166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] PATH_INFO: `/v3/users/5e048d74b095442f97f26d57f823123f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:21.014344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e048d74b095442f97f26d57f823123f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:21.017652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:21.052607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f60dc75f5a4ae5a4142a0a2e572cac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.053302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f60dc75f5a4ae5a4142a0a2e572cac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.060505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f60dc75f5a4ae5a4142a0a2e572cac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.075285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f60dc75f5a4ae5a4142a0a2e572cac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.076088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e305629-d298-4a6e-9488-a79b3702960a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f60dc75f5a4ae5a4142a0a2e572cac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.154775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1015/2043] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:20 2022] DELETE /identity/v3/users/34f60dc75f5a4ae5a4142a0a2e572cac => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:21.156971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88aa71-2b09-48c5-8af9-699b1e916250 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:21.157393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88aa71-2b09-48c5-8af9-699b1e916250 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:21.157711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88aa71-2b09-48c5-8af9-699b1e916250 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:21.160712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1016/2044] 10.222.0.17 () {54 vars in 961 bytes} [Wed Sep 7 14:48:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:48:21.169243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:21.169529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:21.174122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:21.226179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e048d74b095442f97f26d57f823123f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.241011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] MFA Rules not processed for user `43b30d76472244e1a92d4787d0a2be66`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:21.247159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:21.326499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e048d74b095442f97f26d57f823123f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.343807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1017/2045] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Sep 7 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:21.348380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e048d74b095442f97f26d57f823123f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.352473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:21.364056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8087f7-9ae4-4fac-a4e3-2c6a0c2cac46 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:21.368735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e048d74b095442f97f26d57f823123f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.369938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e048d74b095442f97f26d57f823123f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:21.372459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:21.373211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:21.373465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:21.373745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:21.376942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:21.379911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1029/2046] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:20 2022] DELETE /identity/v3/users/5e048d74b095442f97f26d57f823123f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:21.393737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:21.395362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:21.407501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1018/2047] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:21.659988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:21.762790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:21.764566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:21.777649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:21.779100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:21.885515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bc4a-b9f6-436c-89d9-2d412ec5fa18 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:21.897573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:21.898438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:21.898582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:21.898779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] PATH_INFO: `/v3/projects/0b28ea73f24342548dde1f1cd12c9a21` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:21.903573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b28ea73f24342548dde1f1cd12c9a21)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:21.905630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:21.913859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76a04-f9c3-4ced-acda-e772411005e6 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:21.934804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:21.935789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:21.936242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:21.936737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] PATH_INFO: `/v3/projects/286fee8b6ca54b87bd6ec03bc912b7b4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:21.938689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286fee8b6ca54b87bd6ec03bc912b7b4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:21.941002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.103360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b28ea73f24342548dde1f1cd12c9a21', 'request_id': 'req-998cf4f6-f4b3-428e-ac1a-91493550c790'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.111703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286fee8b6ca54b87bd6ec03bc912b7b4', 'request_id': 'req-6d36d0de-f709-4ef9-9d44-e62c1653b664'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.119567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286fee8b6ca54b87bd6ec03bc912b7b4', 'request_id': 'req-6d36d0de-f709-4ef9-9d44-e62c1653b664'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.125323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286fee8b6ca54b87bd6ec03bc912b7b4', 'request_id': 'req-6d36d0de-f709-4ef9-9d44-e62c1653b664'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.205964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b28ea73f24342548dde1f1cd12c9a21', 'request_id': 'req-998cf4f6-f4b3-428e-ac1a-91493550c790'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.212406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b28ea73f24342548dde1f1cd12c9a21', 'request_id': 'req-998cf4f6-f4b3-428e-ac1a-91493550c790'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.224772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] The token cache is being invalidate because project 0b28ea73f24342548dde1f1cd12c9a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:22.225073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.225795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-998cf4f6-f4b3-428e-ac1a-91493550c790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.235026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1030/2048] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:21 2022] DELETE /identity/v3/projects/0b28ea73f24342548dde1f1cd12c9a21 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:22.240158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9566-87fd-40f7-aa28-1d958130bc94 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.240628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9566-87fd-40f7-aa28-1d958130bc94 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.241089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9566-87fd-40f7-aa28-1d958130bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.261843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4dbd9566-87fd-40f7-aa28-1d958130bc94 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:22.263017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4dbd9566-87fd-40f7-aa28-1d958130bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:22.303034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] The token cache is being invalidate because project 286fee8b6ca54b87bd6ec03bc912b7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:22.303364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.304037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d36d0de-f709-4ef9-9d44-e62c1653b664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:22.305902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1019/2049] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:21 2022] DELETE /identity/v3/projects/286fee8b6ca54b87bd6ec03bc912b7b4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:22.312961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421663-e5ba-47fa-8689-2ba7153d61f2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.313250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421663-e5ba-47fa-8689-2ba7153d61f2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.313520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421663-e5ba-47fa-8689-2ba7153d61f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.324578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1031/2050] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:22.332895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.333184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.333463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.336398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-63421663-e5ba-47fa-8689-2ba7153d61f2 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:22.337608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-63421663-e5ba-47fa-8689-2ba7153d61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:22.345794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1020/2051] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:22.353631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:22.354839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:22.357888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.358185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.358471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.363664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1032/2052] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:22.368075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.378165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd6dcc-7eb8-4bfe-8280-16469325bf2a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.385123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.385344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:22.386018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.386420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.386547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:22.386836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.387965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:22.388332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.390915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.396251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1021/2053] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:22.400517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.412287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1033/2054] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:48:22.412602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403867-eccd-4608-9247-c7e2be0e1f71 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.413383 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.440830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.442216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.445064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971ab6-d624-4027-8bac-851af0f0f6e6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.445860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.446215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.446933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:22.447928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.450653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.458010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257473-14dd-4f05-b191-cca5a107ac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.458830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257473-14dd-4f05-b191-cca5a107ac69 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.459278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257473-14dd-4f05-b191-cca5a107ac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.459626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257473-14dd-4f05-b191-cca5a107ac69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.460346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257473-14dd-4f05-b191-cca5a107ac69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.462299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257473-14dd-4f05-b191-cca5a107ac69 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.481437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1022/2055] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:22.486634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.497514 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a8fcd-59cc-49bb-88d8-87f48b12b09e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.503672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.504395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.504651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.505037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.505733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.507734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.559264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1034/2056] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:22.560540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.560822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.564179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.604834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] MFA Rules not processed for user `a5bbb67e431b48c2a9eed217a5235cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:22.604834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:22.630530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1023/2057] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:22.632744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.682668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1035/2058] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:22.682668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.707589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a93f9-5c00-4026-86a5-10dd127cbb7f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.712664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.713300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.713586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.713865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.714513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.716510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.749118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e346-b200-465d-afac-8c833178ee56 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.754610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.755237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.756292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.756581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.757234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.759185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.806472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1024/2059] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:22.807313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.808955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:22.822376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812ce2-8492-4c0a-81f5-656e8694d240 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.827421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.831977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.831977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.831977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.831977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.831977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.886456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1036/2060] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:22.887246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.897580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8b29-e844-4b52-b8f1-822f99420fe8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:22.904031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:22.904651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:22.904939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:22.905224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:22.907149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:22.908339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:22.919416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1037/2061] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:22.920511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.923712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1025/2062] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:22.924721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:22.932930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c900f22-075a-4d97-8bbc-06e7a725786c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.003151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.003922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.004259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.004589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.005367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.007027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.010002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490eb5-00a3-4033-8a24-65305a632dd0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.016321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.017042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.017380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.017657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.021501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1038/2063] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:23.021676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.021778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.021868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.029420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef5fd9-6dfc-45a2-a0c9-a643bbe986c3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.044999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.044999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.044999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.044999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.045381 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.045381 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.053323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1039/2064] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:23.053987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.066237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe8b91-dba9-4e42-9cec-7f28c7b9050d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.070821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.071440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.071778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.072056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.072747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.074389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.086364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1040/2065] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:23.087223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.097796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276a1ea-c03e-43a8-b3b2-bcccb0ad6ef9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.102520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.109718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1026/2066] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:22 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:23.109839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.109839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.109839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] PATH_INFO: `/v3/projects/dffd7464313945e1af9feb2ff7918636/users/26181841b6c6418aa73cf6d8b3c262af/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.110510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.110594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:23.117433 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a393-84d3-4517-8c02-1f4e6c967b65 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.122726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d0368-2aa6-45e9-8289-4f349688b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.123120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dffd7464313945e1af9feb2ff7918636, user_id=26181841b6c6418aa73cf6d8b3c262af, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.123416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d0368-2aa6-45e9-8289-4f349688b20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.123709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d0368-2aa6-45e9-8289-4f349688b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.123986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d0368-2aa6-45e9-8289-4f349688b20f admin admin] PATH_INFO: `/v3/projects/cc0749f1355f400381c192feb848b3a3/users/9f9778cf476c4c90a7d9368b7cf4ff03/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.126545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.142358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d0368-2aa6-45e9-8289-4f349688b20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0749f1355f400381c192feb848b3a3, user_id=9f9778cf476c4c90a7d9368b7cf4ff03, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.144204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d0368-2aa6-45e9-8289-4f349688b20f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.299181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1041/2067] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:23 2022] PUT /identity/v3/projects/dffd7464313945e1af9feb2ff7918636/users/26181841b6c6418aa73cf6d8b3c262af/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:23.299414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1027/2068] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:23 2022] PUT /identity/v3/projects/cc0749f1355f400381c192feb848b3a3/users/9f9778cf476c4c90a7d9368b7cf4ff03/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:23.299516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.303648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17b9b-dc50-4abf-b952-a69d96681883 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.303944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17b9b-dc50-4abf-b952-a69d96681883 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.304226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17b9b-dc50-4abf-b952-a69d96681883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.336018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-14b17b9b-dc50-4abf-b952-a69d96681883 None None] MFA Rules not processed for user `9f9778cf476c4c90a7d9368b7cf4ff03`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:23.340122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-14b17b9b-dc50-4abf-b952-a69d96681883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:23.386307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059ea2-2bbc-4ba0-9b97-a1b26564e21d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.447474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1028/2069] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:23.447474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.447474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.447474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.491637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.492269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.492744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.492949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.498822 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.499089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] MFA Rules not processed for user `26181841b6c6418aa73cf6d8b3c262af`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:23.499617 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.504261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:23.509914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1042/2070] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:23.512589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.513970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:23.544714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:23.588309 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80863d2b-0c75-4742-85eb-937d81843896 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.592821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.594149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.594625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.595630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.605035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.606593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.608341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1029/2071] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:23.609523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.617927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1043/2072] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:23.619620 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.621405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:23.642656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1a22-e909-4835-b5d8-972e4508675a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.655483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.656918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.659304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.659737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] PATH_INFO: `/v3/projects/6879c8578b40418baef55c09f85351ad/users/415fd79f71ae4433b0eea879fef51f40/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.681236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6879c8578b40418baef55c09f85351ad, user_id=415fd79f71ae4433b0eea879fef51f40, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.684448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.740095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610c680-3ff9-4239-903a-50a91f304889 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.752091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.752721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.753004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.753263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.766692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.768767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.787513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1044/2073] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:23.819086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1030/2074] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:23 2022] PUT /identity/v3/projects/6879c8578b40418baef55c09f85351ad/users/415fd79f71ae4433b0eea879fef51f40/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:23.823466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.837313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a9b6-02c8-4cdc-b8e4-444efb8f2bed service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.912535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50320e-1c2a-42a4-acff-380eb0f2142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.913440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50320e-1c2a-42a4-acff-380eb0f2142d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.913860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50320e-1c2a-42a4-acff-380eb0f2142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.914593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50320e-1c2a-42a4-acff-380eb0f2142d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.922240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50320e-1c2a-42a4-acff-380eb0f2142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.922240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50320e-1c2a-42a4-acff-380eb0f2142d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.930588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1045/2075] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:23.934769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:23.947054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255304a-e152-40b9-abef-985a4f96aaf3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:23.952208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782169-5c6e-43ad-abd0-e51bab1530af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:23.953695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782169-5c6e-43ad-abd0-e51bab1530af admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:23.953695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782169-5c6e-43ad-abd0-e51bab1530af admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:23.953695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782169-5c6e-43ad-abd0-e51bab1530af admin admin] PATH_INFO: `/v3/projects/6879c8578b40418baef55c09f85351ad/users/415fd79f71ae4433b0eea879fef51f40/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:23.955849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782169-5c6e-43ad-abd0-e51bab1530af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6879c8578b40418baef55c09f85351ad, user_id=415fd79f71ae4433b0eea879fef51f40, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:23.958558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782169-5c6e-43ad-abd0-e51bab1530af admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:23.978770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1031/2076] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:23 2022] PUT /identity/v3/projects/6879c8578b40418baef55c09f85351ad/users/415fd79f71ae4433b0eea879fef51f40/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:25.408393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a1d0-2711-47b1-af2f-edc268d7aa1b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:25.408989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a1d0-2711-47b1-af2f-edc268d7aa1b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:25.408989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a1d0-2711-47b1-af2f-edc268d7aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:25.439284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8195a1d0-2711-47b1-af2f-edc268d7aa1b None None] MFA Rules not processed for user `415fd79f71ae4433b0eea879fef51f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:25.440456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8195a1d0-2711-47b1-af2f-edc268d7aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:25.557963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1046/2077] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:25.566317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:25.566901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:25.567147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:25.589501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:25.589782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:25.590060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:25.594071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] MFA Rules not processed for user `a5bbb67e431b48c2a9eed217a5235cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:25.595393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:25.615828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] MFA Rules not processed for user `9f9778cf476c4c90a7d9368b7cf4ff03`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:25.617111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:25.650192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:25.660132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1032/2078] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:25.671497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:25.685806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1047/2079] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:25.753552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098e2bb-c2c4-4246-a54c-fd0432c563f6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:25.759252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6d9be-ef69-472a-8550-69ccb4917ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:25.760837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6d9be-ef69-472a-8550-69ccb4917ff8 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:25.760837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6d9be-ef69-472a-8550-69ccb4917ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:25.760837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6d9be-ef69-472a-8550-69ccb4917ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:25.769062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6d9be-ef69-472a-8550-69ccb4917ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:25.770642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6d9be-ef69-472a-8550-69ccb4917ff8 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:25.778220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:25.787596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1033/2080] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:26.433131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:26.553283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:27.387707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:27.834423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:28.424377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:28.536967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:28.554950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:28.605423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2be8-9b78-4a62-9dd9-41af0910d45c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:28.611362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:28.612014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:28.612293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:28.612566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] PATH_INFO: `/v3/users/26181841b6c6418aa73cf6d8b3c262af` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:28.613673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26181841b6c6418aa73cf6d8b3c262af)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:28.615625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:28.794875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:28.799262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26181841b6c6418aa73cf6d8b3c262af'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:28.829348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:28.878946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26181841b6c6418aa73cf6d8b3c262af'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:28.893135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26181841b6c6418aa73cf6d8b3c262af'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:28.900003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26181841b6c6418aa73cf6d8b3c262af'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:28.900705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26181841b6c6418aa73cf6d8b3c262af'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:28.910638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1048/2081] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:28 2022] DELETE /identity/v3/users/26181841b6c6418aa73cf6d8b3c262af => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:28.912298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:28.912792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:28.912917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:28.935507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:28.936717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:29.001581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1034/2082] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:29.012708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:29.014234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:29.059129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.077180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ac83e-7e2d-4990-9f52-4a0a96246ae8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:29.080984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a39286-2539-496b-a9ef-d9b2e2447b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:29.081589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a39286-2539-496b-a9ef-d9b2e2447b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:29.081879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a39286-2539-496b-a9ef-d9b2e2447b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:29.082156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a39286-2539-496b-a9ef-d9b2e2447b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:29.091230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a39286-2539-496b-a9ef-d9b2e2447b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:29.091615 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.092703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a39286-2539-496b-a9ef-d9b2e2447b35 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:29.102535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1049/2083] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:29.296601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.336928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.432809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.530265 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.568296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:29.569892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:29.584457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185384df-a4a6-4afa-8323-e93bedc93509 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:29.589310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:29.590079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:29.590425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:29.590773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] PATH_INFO: `/v3/projects/dffd7464313945e1af9feb2ff7918636` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:29.592122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dffd7464313945e1af9feb2ff7918636)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:29.597400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:29.719014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dffd7464313945e1af9feb2ff7918636', 'request_id': 'req-1701043b-efcf-43e5-b5af-b964260990a1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:29.730523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dffd7464313945e1af9feb2ff7918636', 'request_id': 'req-1701043b-efcf-43e5-b5af-b964260990a1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:29.738335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dffd7464313945e1af9feb2ff7918636', 'request_id': 'req-1701043b-efcf-43e5-b5af-b964260990a1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:29.782908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.828931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] The token cache is being invalidate because project dffd7464313945e1af9feb2ff7918636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:29.829327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:29.830039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1701043b-efcf-43e5-b5af-b964260990a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:29.831673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1035/2084] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:29 2022] DELETE /identity/v3/projects/dffd7464313945e1af9feb2ff7918636 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:29.833930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.837061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:29.837384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:29.837714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:29.857477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:29.859518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:29.924920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1050/2085] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:29.931227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.933710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:29.934164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:29.934319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:29.955231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:29.956481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:29.964744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1036/2086] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:29.969570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:29.979598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696019a5-7fcb-42be-a896-78bea6c8d12c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:29.984418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:29.985096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:29.985382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:29.985658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:29.986387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:29.986698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:29.988349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.000818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1051/2087] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:48:30.005266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:30.014512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bf195-fdde-4cbf-b4e6-55a9adbc0e4a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:30.019181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:30.019814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.020095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.020368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.021024 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:30.026179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.156877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1037/2088] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:30 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:30.161216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:30.173068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ae174-0f00-4393-90f3-ecb449375401 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:30.243198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:30.243946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.244362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.245101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.245650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:30.247760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.274588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:30.363431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1052/2089] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:30 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:30.367677 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:30.387218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c3b36-a3bd-482c-b437-6480a7a625d3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:30.401431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:30.401431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.401619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.401852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.402815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:30.404667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.419550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1038/2090] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:30.422019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:30.439795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383017c-54ae-4888-bfca-66bcc10d77bc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:30.447246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421276-ab6e-43c4-95a3-4f7b3037810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:30.448000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421276-ab6e-43c4-95a3-4f7b3037810e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.448354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421276-ab6e-43c4-95a3-4f7b3037810e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.449284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421276-ab6e-43c4-95a3-4f7b3037810e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.449770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421276-ab6e-43c4-95a3-4f7b3037810e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:30.451879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421276-ab6e-43c4-95a3-4f7b3037810e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.459880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:30.465066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1053/2091] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:30.469776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:30.480495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b3b1-6fe3-4ef5-aa99-ccb65e7417f7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:30.486430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:30.487554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.487554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.487801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] PATH_INFO: `/v3/projects/94e169ef49ac42ec8104b5ee0df688df/users/8a8be44333b3416697f5bbbd3cdb6302/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.506537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e169ef49ac42ec8104b5ee0df688df, user_id=8a8be44333b3416697f5bbbd3cdb6302, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:30.509457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.622239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1039/2092] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:30 2022] PUT /identity/v3/projects/94e169ef49ac42ec8104b5ee0df688df/users/8a8be44333b3416697f5bbbd3cdb6302/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:30.633201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4022e1-dd8b-4ba8-bdbe-00e99ae72845 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.633690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4022e1-dd8b-4ba8-bdbe-00e99ae72845 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.633770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4022e1-dd8b-4ba8-bdbe-00e99ae72845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.662961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6e4022e1-dd8b-4ba8-bdbe-00e99ae72845 None None] MFA Rules not processed for user `8a8be44333b3416697f5bbbd3cdb6302`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:30.664213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6e4022e1-dd8b-4ba8-bdbe-00e99ae72845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:30.720651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:30.741017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1054/2093] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:30.752681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:30.754528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:30.840455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100242cc-1561-488f-9e33-7beb6b40b106 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:30.846374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:30.861809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:30.862105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:30.862474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:30.881055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:30.882430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:30.896145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1040/2094] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:34.346101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:34.346608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:34.346702 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:34.368142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] MFA Rules not processed for user `6171a56ade8b47fe95c4ab932bb7e489`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:34.369462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:34.429935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1055/2095] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:40.888743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:41.371273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:41.373139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:41.424323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:41.530103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb73ee-d042-4846-9dd2-0a77f335c634 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:41.536985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:41.537645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:41.537931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:41.538227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] PATH_INFO: `/v3/users/8a8be44333b3416697f5bbbd3cdb6302` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:41.539469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8be44333b3416697f5bbbd3cdb6302)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:41.542218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:41.571081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84c5a-88b4-43e9-87a8-0c545ec3f194 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:41.580829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:41.582188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:41.582487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:41.585139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] PATH_INFO: `/v3/users/6d51ba6e485e4be59e5a5a482afd7152` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:41.585139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d51ba6e485e4be59e5a5a482afd7152)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:41.586889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:41.795283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8be44333b3416697f5bbbd3cdb6302'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.813723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d51ba6e485e4be59e5a5a482afd7152'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.814413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d51ba6e485e4be59e5a5a482afd7152'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.821620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d51ba6e485e4be59e5a5a482afd7152'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.835109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d51ba6e485e4be59e5a5a482afd7152'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.835940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5e7283dd-ffd9-4e53-b968-c53e025a12e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d51ba6e485e4be59e5a5a482afd7152'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.901954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8be44333b3416697f5bbbd3cdb6302'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.923980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8be44333b3416697f5bbbd3cdb6302'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.938289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8be44333b3416697f5bbbd3cdb6302'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.939172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-73291737-7414-4919-acc7-cdf0bee4e68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8be44333b3416697f5bbbd3cdb6302'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:41.946783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1056/2096] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:41 2022] DELETE /identity/v3/users/8a8be44333b3416697f5bbbd3cdb6302 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:41.951942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:41.952418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:41.953390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:41.975483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:41.976713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:41.988151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:42.030638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1041/2097] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:41 2022] DELETE /identity/v3/users/6d51ba6e485e4be59e5a5a482afd7152 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:42.035813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:42.036109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:42.036392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:42.061109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1057/2098] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:42.061323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:42.071005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:42.073584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:42.073803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:42.182460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1042/2099] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:42.186332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d668f-a95d-43aa-bba2-3075189adc0f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:42.193197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:42.195534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:42.242747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:42.280244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:42.281590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:42.281992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:42.282276 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:42.303281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:42.303281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:42.311760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4ce59-6c5a-48be-afd7-bce2a60f9a1f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:42.318386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1058/2100] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:42.322118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:42.322927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:42.323363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:42.323844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:42.334997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:42.336762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:42.353234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1043/2101] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:43.023197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.024758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:43.039804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76314-96ad-4c67-a56c-56b534f1d4d7 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.046272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.048997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.048997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.048997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] PATH_INFO: `/v3/projects/94e169ef49ac42ec8104b5ee0df688df` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.049292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e169ef49ac42ec8104b5ee0df688df)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.051117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.115430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.116967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:43.131292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9be2-8e03-46c3-8d63-e1ad7ad6c361 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.136458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.136768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.137050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.137324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] PATH_INFO: `/v3/projects/b519bd21555f4b0aaf29beab1573490f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.138455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b519bd21555f4b0aaf29beab1573490f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.140532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.199962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e169ef49ac42ec8104b5ee0df688df', 'request_id': 'req-3a43152d-a680-4500-b924-79d1f32f90d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.291109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b519bd21555f4b0aaf29beab1573490f', 'request_id': 'req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.296930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e169ef49ac42ec8104b5ee0df688df', 'request_id': 'req-3a43152d-a680-4500-b924-79d1f32f90d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.298342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b519bd21555f4b0aaf29beab1573490f', 'request_id': 'req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.302968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e169ef49ac42ec8104b5ee0df688df', 'request_id': 'req-3a43152d-a680-4500-b924-79d1f32f90d3'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.303966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b519bd21555f4b0aaf29beab1573490f', 'request_id': 'req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.306178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:43.317680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] The token cache is being invalidate because project 94e169ef49ac42ec8104b5ee0df688df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:43.317916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.318568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3a43152d-a680-4500-b924-79d1f32f90d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.320112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1059/2102] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:43 2022] DELETE /identity/v3/projects/94e169ef49ac42ec8104b5ee0df688df => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:43.324823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc59a7-a9ce-4204-ad4d-53b2550f51f7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.325106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc59a7-a9ce-4204-ad4d-53b2550f51f7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.325380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc59a7-a9ce-4204-ad4d-53b2550f51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.345974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ddcc59a7-a9ce-4204-ad4d-53b2550f51f7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:43.347154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ddcc59a7-a9ce-4204-ad4d-53b2550f51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:43.405930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] The token cache is being invalidate because project b519bd21555f4b0aaf29beab1573490f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:43.406446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.407282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7e49e5a2-2331-4aca-bdc0-8b20a91ba449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:43.412463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1044/2103] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:43 2022] DELETE /identity/v3/projects/b519bd21555f4b0aaf29beab1573490f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:43.414068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094288a-7a1d-459b-b9fe-e3cb0b2792f5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.414196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094288a-7a1d-459b-b9fe-e3cb0b2792f5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.414407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094288a-7a1d-459b-b9fe-e3cb0b2792f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.425263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1060/2104] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:43.426935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.427348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.428287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.446221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3094288a-7a1d-459b-b9fe-e3cb0b2792f5 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:43.447745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3094288a-7a1d-459b-b9fe-e3cb0b2792f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:43.453441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:43.454574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:43.457247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1045/2105] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:43.466725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.466725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.466725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.473479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1061/2106] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:43.482630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.489734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:43.490924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:43.492295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f56a1-15db-4936-ae82-5c44c50dfcd0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.497468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.498081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.498366 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.498644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.499941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:43.500262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.503807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.503913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1046/2107] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:43.506608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.515858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1062/2108] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:48:43.516083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6f79-0647-4115-8f00-e69b87f7c308 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.519998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.522216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.522839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.523124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.523415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.524390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:48:43.524390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.526338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.532828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56a54-dd9f-417c-8a2c-6938b9bec8d1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.538670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.538929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1047/2109] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:48:43.539288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.539627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.540240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.540601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.542595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.543291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.568086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa584-e419-4d26-bee3-d01d2c6cde0c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.574401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.575735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.576460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.576801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.577560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.581526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.647437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1063/2110] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:48:43.651311 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.705638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1048/2111] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/projects => generated 397 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:43.709932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.753826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b02ec-e85f-4def-9eef-611580e7eed2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.790466 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:43.797423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abb10f-6462-447b-9b99-fe3740143726 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.813378 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.820179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.820179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.820179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.820179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.820179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.837341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.837989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.838241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.838514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.839149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.841115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.850793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:43.908629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1049/2112] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:48:43.912645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.927362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87082c-e124-4e86-89e1-bb7a70c0fc3a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.933170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.933787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.934062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.934330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.934980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.936637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.948598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1050/2113] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:43.952924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:43.972020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f403-da43-42ac-80e4-ba881ec92ddb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:43.976956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:43.977822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:43.978137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:43.978482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:43.979195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:43.981149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:43.993009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1051/2114] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:43.997140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.007985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369279e-6c1d-4bc2-af23-49adf8746cfd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.012729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9175b-8dc4-4acb-8d1a-2379adaa11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.013371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9175b-8dc4-4acb-8d1a-2379adaa11c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.013658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9175b-8dc4-4acb-8d1a-2379adaa11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.013939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9175b-8dc4-4acb-8d1a-2379adaa11c5 admin admin] PATH_INFO: `/v3/projects/55891b9994994c189912b6e80422a10c/users/1a5852e812d04641977ba01fda54a164/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.029386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9175b-8dc4-4acb-8d1a-2379adaa11c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55891b9994994c189912b6e80422a10c, user_id=1a5852e812d04641977ba01fda54a164, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.036075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9175b-8dc4-4acb-8d1a-2379adaa11c5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.081861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1064/2115] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:43 2022] POST /identity/v3/users => generated 287 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:48:44.085777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.103818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a072ac-e92e-4ec8-aef7-171d99edca77 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.108605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.110247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.110385 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.110653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.111302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.112928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.127445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1065/2116] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:44.130622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.142326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c89dd2-c73d-4173-834b-2f04dd5e71ea admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.147816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.148577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.148852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.149131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.149776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.151360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.162657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1066/2117] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:44.166906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.173628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1052/2118] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:43 2022] PUT /identity/v3/projects/55891b9994994c189912b6e80422a10c/users/1a5852e812d04641977ba01fda54a164/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:48:44.191802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.192733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade088c8-3416-4647-b30e-d3ccf1dc2d1f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.193099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.194324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.242329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] MFA Rules not processed for user `1a5852e812d04641977ba01fda54a164`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:44.243818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:44.300013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.300858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.301151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.301407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] PATH_INFO: `/v3/projects/ac7388ce39e244bba3e2048f47fc9921/users/220c9de33f0147318f5f111a27805125/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.318964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7388ce39e244bba3e2048f47fc9921, user_id=220c9de33f0147318f5f111a27805125, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.323299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1053/2119] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:44.332483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.334005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.336061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:44.396579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1d81-9988-4277-8c87-af13cafe5d50 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.400278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9a03-a33f-4120-9473-13c767607b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.400897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9a03-a33f-4120-9473-13c767607b76 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.401313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9a03-a33f-4120-9473-13c767607b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.401613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9a03-a33f-4120-9473-13c767607b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.411799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9a03-a33f-4120-9473-13c767607b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.413383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9a03-a33f-4120-9473-13c767607b76 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.423256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1054/2120] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:44.426988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1067/2121] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:44 2022] PUT /identity/v3/projects/ac7388ce39e244bba3e2048f47fc9921/users/220c9de33f0147318f5f111a27805125/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:44.438608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.438895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.439170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.469060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] MFA Rules not processed for user `220c9de33f0147318f5f111a27805125`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:44.470235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:44.490977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:44.547906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1055/2122] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:44.554492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.627045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814c88-5c80-46d3-aded-4a14eade836c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.632542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.633330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.633619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.633905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.634547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.636650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.776390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1068/2123] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:48:44 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:44.780781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.792086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f428cdb-a0d5-49fb-835b-ed745359b648 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.853645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.854317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.854602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.854879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.855562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.857516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.933727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1056/2124] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:48:44 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:48:44.938596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.952672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851887c1-1122-47da-930d-3cdfe50bb431 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:44.958056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:44.958713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:44.959027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:44.959277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:44.959973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:44.961718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:44.976506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1069/2125] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:48:44.982578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:44.993829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cc400-9582-4c4c-a02d-623cb1968a87 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:45.001244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:45.002039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:45.002335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:45.002619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] PATH_INFO: `/v3/projects/d854c8575f2c422091af8deb0a881129/users/70a0eaef066a439dba38a803b32f45f7/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:45.022785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d854c8575f2c422091af8deb0a881129, user_id=70a0eaef066a439dba38a803b32f45f7, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:45.025475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:45.121724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1057/2126] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:44 2022] PUT /identity/v3/projects/d854c8575f2c422091af8deb0a881129/users/70a0eaef066a439dba38a803b32f45f7/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:45.127489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:45.139848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebb7e5-714e-4b23-b8af-c6e8af188be0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:45.200108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:45.238536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf37bc4-45fd-4cb1-86e7-6f3db3264c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:45.239533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37bc4-45fd-4cb1-86e7-6f3db3264c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:45.239883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37bc4-45fd-4cb1-86e7-6f3db3264c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:45.240251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37bc4-45fd-4cb1-86e7-6f3db3264c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:45.241356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf37bc4-45fd-4cb1-86e7-6f3db3264c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:45.243488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf37bc4-45fd-4cb1-86e7-6f3db3264c5b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:45.255435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1070/2127] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:48:45.260083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:45.278453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620235e8-1b70-42b7-bd9b-a1ef2c208f9b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:45.283842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:45.284513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:45.284791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:45.285118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] PATH_INFO: `/v3/projects/d854c8575f2c422091af8deb0a881129/users/70a0eaef066a439dba38a803b32f45f7/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:45.287043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d854c8575f2c422091af8deb0a881129, user_id=70a0eaef066a439dba38a803b32f45f7, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:45.289825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:45.302679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1058/2128] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:48:45 2022] PUT /identity/v3/projects/d854c8575f2c422091af8deb0a881129/users/70a0eaef066a439dba38a803b32f45f7/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:45.313694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:45.314162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:45.314548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:45.349640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] MFA Rules not processed for user `70a0eaef066a439dba38a803b32f45f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:45.351830 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:45.456692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1071/2129] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:48:45.464730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:45.546310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55058b-493c-486b-a594-fcfb2d558ab0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:45.550091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:45.550721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:45.551004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:45.551274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:45.562332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:45.563884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:45.575014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1059/2130] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:45.790499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:45.804633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011d3a1-fe9e-4309-8cfc-ae669f54c07f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:45.810541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52b7a5-17f4-45bd-a6ab-df2ce36bd363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:45.811158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b7a5-17f4-45bd-a6ab-df2ce36bd363 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:45.811486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b7a5-17f4-45bd-a6ab-df2ce36bd363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:45.812358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52b7a5-17f4-45bd-a6ab-df2ce36bd363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:45.873510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b7a5-17f4-45bd-a6ab-df2ce36bd363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:45.875946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52b7a5-17f4-45bd-a6ab-df2ce36bd363 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:45.888372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1072/2131] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:48:50.882123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:50.903319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:50.950924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04ce72-662d-416f-8ded-124d58818434 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:50.956542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:50.957175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:50.957458 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:50.957736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] PATH_INFO: `/v3/users/1a5852e812d04641977ba01fda54a164` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:50.958857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5852e812d04641977ba01fda54a164)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:50.960801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:51.234078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5852e812d04641977ba01fda54a164'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:51.234078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5852e812d04641977ba01fda54a164'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:51.238838 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5852e812d04641977ba01fda54a164'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:51.252391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5852e812d04641977ba01fda54a164'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:51.253285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5852e812d04641977ba01fda54a164'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:51.329328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1060/2132] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:50 2022] DELETE /identity/v3/users/1a5852e812d04641977ba01fda54a164 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:51.333856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6750-c772-4f94-a27d-8184674368bb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:51.334377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6750-c772-4f94-a27d-8184674368bb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:51.334478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6750-c772-4f94-a27d-8184674368bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:51.354695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-942b6750-c772-4f94-a27d-8184674368bb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:51.356057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-942b6750-c772-4f94-a27d-8184674368bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:51.401732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:51.429608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1073/2133] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:51.433192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:51.434955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:51.509520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1a82-4622-4bf2-afd9-4cbfff5c4fba admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:51.514112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:51.516127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:51.517204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:51.517521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:51.528439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:51.529904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:51.540388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1061/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:52.098750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6750-c772-4f94-a27d-8184674368bb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:52.101164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-942b6750-c772-4f94-a27d-8184674368bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:52.215745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6750-c772-4f94-a27d-8184674368bb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:52.220795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:52.221596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:52.221780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:52.222067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:52.225688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:52.291970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:52.294941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:52.314314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41893af4-5031-48f1-a2dd-804b6ace977f service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:52.320736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:52.322140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:52.322140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:52.322140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] PATH_INFO: `/v3/projects/55891b9994994c189912b6e80422a10c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:52.323213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55891b9994994c189912b6e80422a10c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:52.325225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:52.336182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:52.344661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ed560-da60-41ee-a151-2464ef550088 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:52.367167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1074/2135] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:48:52.514319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:52.526559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55891b9994994c189912b6e80422a10c', 'request_id': 'req-73e533cd-e56b-44dd-b719-15f4cd3a2808'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:52.533886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55891b9994994c189912b6e80422a10c', 'request_id': 'req-73e533cd-e56b-44dd-b719-15f4cd3a2808'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:52.539578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55891b9994994c189912b6e80422a10c', 'request_id': 'req-73e533cd-e56b-44dd-b719-15f4cd3a2808'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:52.621595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] The token cache is being invalidate because project 55891b9994994c189912b6e80422a10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:48:52.621895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:52.622555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:52.624156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1062/2136] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:48:52 2022] DELETE /identity/v3/projects/55891b9994994c189912b6e80422a10c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:53.377744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d890d4-e571-4561-ac89-d11382193ca9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:53.378224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d890d4-e571-4561-ac89-d11382193ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:53.378363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d890d4-e571-4561-ac89-d11382193ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:53.402764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-12d890d4-e571-4561-ac89-d11382193ca9 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:53.405012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-12d890d4-e571-4561-ac89-d11382193ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:53.463349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1075/2137] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:53.514209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:53.514209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:53.587112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e533cd-e56b-44dd-b719-15f4cd3a2808 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:53.592368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:53.592980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:53.593261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:53.593536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:53.602326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:53.603933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:53.613279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1063/2138] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:48:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:48:54.482638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0527a4-dddf-49b2-90be-9d80d0f560ac None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:54.483093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0527a4-dddf-49b2-90be-9d80d0f560ac None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:54.483188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0527a4-dddf-49b2-90be-9d80d0f560ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:54.503114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8e0527a4-dddf-49b2-90be-9d80d0f560ac None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:54.504343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8e0527a4-dddf-49b2-90be-9d80d0f560ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:54.512792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1076/2139] 10.222.0.17 () {58 vars in 967 bytes} [Wed Sep 7 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:54.526083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:54.537413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c649e-9b6d-4a54-8a4e-fc4ed0c9f18f service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:54.542923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:54.543565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:54.543854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:54.544133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:54.554959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:54.556603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:54.565914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1064/2140] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:48:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:48:55.335177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50c32-0e8a-4819-9ef7-995ecc012b98 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:55.335497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50c32-0e8a-4819-9ef7-995ecc012b98 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:55.339542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50c32-0e8a-4819-9ef7-995ecc012b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:55.356086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7fd50c32-0e8a-4819-9ef7-995ecc012b98 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:55.357322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7fd50c32-0e8a-4819-9ef7-995ecc012b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:55.364988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1077/2141] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:55.378010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:55.388660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa60523-4541-420a-ae0b-f9c326f18144 service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:55.393837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:55.398846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:55.398846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:55.398846 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:55.403056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:55.404681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:55.413243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1065/2142] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:48:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 14:48:56.071723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:56.072193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:56.072348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:56.107367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:56.109388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:56.123036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1078/2143] 10.222.0.17 () {58 vars in 967 bytes} [Wed Sep 7 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:56.137232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:56.148790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca522667-6ff0-48cd-8014-f6f25d190096 service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:56.159621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2ae57-466f-4222-8f55-aff82c41989a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:56.160668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ae57-466f-4222-8f55-aff82c41989a service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:56.161114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ae57-466f-4222-8f55-aff82c41989a service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:56.161560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ae57-466f-4222-8f55-aff82c41989a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:56.173005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2ae57-466f-4222-8f55-aff82c41989a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:56.175702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2ae57-466f-4222-8f55-aff82c41989a service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:56.187337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1066/2144] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:48:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:48:59.373715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:59.375904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:59.410109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:59.503149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ded7a-0126-4fc1-a8e7-fe2f5758b47c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:59.509023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:59.510619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:59.511149 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:59.511463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] PATH_INFO: `/v3/users/9f9778cf476c4c90a7d9368b7cf4ff03` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:59.512679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9778cf476c4c90a7d9368b7cf4ff03)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:48:59.515169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:48:59.737160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9778cf476c4c90a7d9368b7cf4ff03'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:59.781740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9778cf476c4c90a7d9368b7cf4ff03'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:59.800300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9778cf476c4c90a7d9368b7cf4ff03'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:59.810761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9778cf476c4c90a7d9368b7cf4ff03'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:59.811751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9778cf476c4c90a7d9368b7cf4ff03'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:48:59.826131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1079/2145] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:48:59 2022] DELETE /identity/v3/users/9f9778cf476c4c90a7d9368b7cf4ff03 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:48:59.827953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:59.828745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:59.829076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:48:59.852315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:48:59.853540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:59.914864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1067/2146] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:48:59.925331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:48:59.926746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:48:59.988118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1944490-a145-4f06-97ff-f808ca9bd249 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:48:59.992804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9e0a2-0855-4982-a2bc-739a2a46b8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:48:59.993538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9e0a2-0855-4982-a2bc-739a2a46b8cf service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:48:59.993948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9e0a2-0855-4982-a2bc-739a2a46b8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:48:59.994085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9e0a2-0855-4982-a2bc-739a2a46b8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:00.005636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9e0a2-0855-4982-a2bc-739a2a46b8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:00.007113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9e0a2-0855-4982-a2bc-739a2a46b8cf service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:00.027861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1080/2147] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:00.360796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:00.363664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:00.393611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20627-5e42-4071-83fb-67e2dc0b73f3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:00.400210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:00.401678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:00.402288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:00.402813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] PATH_INFO: `/v3/projects/cc0749f1355f400381c192feb848b3a3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:00.408042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0749f1355f400381c192feb848b3a3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:00.409659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:00.421901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:00.611639 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0749f1355f400381c192feb848b3a3', 'request_id': 'req-7b542c55-c170-4c07-84ad-03d7b2b3ece8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:00.619134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0749f1355f400381c192feb848b3a3', 'request_id': 'req-7b542c55-c170-4c07-84ad-03d7b2b3ece8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:00.625248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0749f1355f400381c192feb848b3a3', 'request_id': 'req-7b542c55-c170-4c07-84ad-03d7b2b3ece8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:00.717035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] The token cache is being invalidate because project cc0749f1355f400381c192feb848b3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:00.717381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:00.718013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7b542c55-c170-4c07-84ad-03d7b2b3ece8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:00.719689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1068/2148] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:00 2022] DELETE /identity/v3/projects/cc0749f1355f400381c192feb848b3a3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:00.724954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:00.725450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:00.725553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:00.746982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:00.748257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:00.791693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:00.810540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1081/2149] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:00.819269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:00.819549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:00.819830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:00.839973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:00.841184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:00.850011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1069/2150] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:00.854270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:00.864959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4bdca-3a09-4ebe-a93b-564d7da40a48 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:00.869960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:00.872305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:00.872305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:00.872305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:00.872305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:00.872305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:00.873738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:00.888864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1082/2151] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:49:00.893175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:00.904734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85049-7624-4812-8fb9-b323073b44dc None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:00.911071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:00.911764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:00.912047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:00.912328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:00.913276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:00.917144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:01.041154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1070/2152] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:00 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:01.045289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:01.056039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005efa-1c32-4734-ba56-d0e670f74c35 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:01.111110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:01.111670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:01.111948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:01.112217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:01.112835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:01.114732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:01.217104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1083/2153] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:01 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:01.222156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:01.233927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1895296-b9e2-4bf0-bf5d-44df5cd28581 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:01.239888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:01.241165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:01.241165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:01.241470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:01.242269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:01.244261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:01.259328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1071/2154] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:01.260574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:01.271767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d1125-7827-49a7-a23f-4583987034fe admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:01.277115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886a157-0314-4486-8791-c8d6efed5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:01.277825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886a157-0314-4486-8791-c8d6efed5f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:01.278105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886a157-0314-4486-8791-c8d6efed5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:01.278562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886a157-0314-4486-8791-c8d6efed5f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:01.279220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886a157-0314-4486-8791-c8d6efed5f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:01.280873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886a157-0314-4486-8791-c8d6efed5f70 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:01.295456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1084/2155] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:01.300712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:01.311927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668da4e-b439-42c0-826e-979ad7ddacf4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:01.317993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:01.318664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:01.318942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:01.319223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] PATH_INFO: `/v3/projects/2c3529b7253b4befb130c4a6a2b63e5a/users/8c3c4cc5821742989fd3aebf05fa1acf/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:01.336216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3529b7253b4befb130c4a6a2b63e5a, user_id=8c3c4cc5821742989fd3aebf05fa1acf, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:01.338942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:01.439279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1072/2156] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:01 2022] PUT /identity/v3/projects/2c3529b7253b4befb130c4a6a2b63e5a/users/8c3c4cc5821742989fd3aebf05fa1acf/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:01.444943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf98fc-0521-4590-996c-822a64450848 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:01.445252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf98fc-0521-4590-996c-822a64450848 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:01.445601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf98fc-0521-4590-996c-822a64450848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:01.474589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-30bf98fc-0521-4590-996c-822a64450848 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:01.475858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-30bf98fc-0521-4590-996c-822a64450848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:01.568373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1085/2157] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:01.578242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:01.580233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:01.639423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06980-adeb-407c-b15c-b5a5977ddafd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:01.643770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:01.644381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:01.644656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:01.644956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:01.654446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:01.655973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:01.665415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1073/2158] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:03.155426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840dc6-de5b-4f4a-b9e8-ac78b67bde85 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:03.156429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840dc6-de5b-4f4a-b9e8-ac78b67bde85 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:03.156705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840dc6-de5b-4f4a-b9e8-ac78b67bde85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:03.220729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7d840dc6-de5b-4f4a-b9e8-ac78b67bde85 None None] MFA Rules not processed for user `8c3c4cc5821742989fd3aebf05fa1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:03.223345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7d840dc6-de5b-4f4a-b9e8-ac78b67bde85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:03.286479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:03.332259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1086/2159] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:03.418089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:03.420322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:03.488611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:03.506729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a08c4e-63ae-47e4-883b-14e559d72983 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:03.510463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec5eee-824a-42d9-9f35-63af5b6e151a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:03.511252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec5eee-824a-42d9-9f35-63af5b6e151a service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:03.511643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec5eee-824a-42d9-9f35-63af5b6e151a service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:03.511990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec5eee-824a-42d9-9f35-63af5b6e151a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:03.523588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec5eee-824a-42d9-9f35-63af5b6e151a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:03.525121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec5eee-824a-42d9-9f35-63af5b6e151a service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:03.535917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1074/2160] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:05.521571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:05.522582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:05.523005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:05.547119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] MFA Rules not processed for user `8c3c4cc5821742989fd3aebf05fa1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:05.548642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:05.555858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1087/2161] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:05.684877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6fa1-2fd2-4bd5-a612-6359378141eb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:05.685684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6fa1-2fd2-4bd5-a612-6359378141eb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:05.686126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd6fa1-2fd2-4bd5-a612-6359378141eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:05.712944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-16fd6fa1-2fd2-4bd5-a612-6359378141eb None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:05.714972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-16fd6fa1-2fd2-4bd5-a612-6359378141eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:05.802658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1075/2162] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:05.822086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:05.823666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:05.926096 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614aa63-5aef-461c-a44e-ff6898ab41fb None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:05.934085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45a24e-53ca-484b-b9aa-529f0e83c843 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:05.934772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45a24e-53ca-484b-b9aa-529f0e83c843 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:05.935048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45a24e-53ca-484b-b9aa-529f0e83c843 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:05.935350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45a24e-53ca-484b-b9aa-529f0e83c843 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:05.944782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45a24e-53ca-484b-b9aa-529f0e83c843 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:05.946361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45a24e-53ca-484b-b9aa-529f0e83c843 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:05.956398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1088/2163] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:49:08.516261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:08.517251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:08.517534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:08.544235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] MFA Rules not processed for user `043a6435674346aaa31dd842f8e12f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:08.546184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:08.640641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1076/2164] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:15.957107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=44 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:18.630360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=60 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:20.381234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:20.382216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:20.382826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:20.431215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] MFA Rules not processed for user `4fd98abc30e940728d3810a4369b6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:20.432630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:20.558867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1089/2165] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:22.714951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:22.717395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:22.734900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adb6da-3b10-4495-9094-0142f0d4b146 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:22.746338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:22.747800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:22.748287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:22.748882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] PATH_INFO: `/v3/users/a5bbb67e431b48c2a9eed217a5235cb3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:22.750858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bbb67e431b48c2a9eed217a5235cb3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:22.753583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:23.036747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bbb67e431b48c2a9eed217a5235cb3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:23.038089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bbb67e431b48c2a9eed217a5235cb3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:23.053697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bbb67e431b48c2a9eed217a5235cb3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:23.069527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bbb67e431b48c2a9eed217a5235cb3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:23.070394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bbb67e431b48c2a9eed217a5235cb3'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:23.144678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1077/2166] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:22 2022] DELETE /identity/v3/users/a5bbb67e431b48c2a9eed217a5235cb3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:23.639266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:23.668011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f87407-9a52-4742-9621-9d71e5250c56 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:23.780405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:23.781128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:23.781903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:23.782171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] PATH_INFO: `/v3/projects/7a7d12d12c1d4bc69d0c3693814e7280` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:23.789347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7d12d12c1d4bc69d0c3693814e7280)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:23.792310 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:23.951688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7d12d12c1d4bc69d0c3693814e7280', 'request_id': 'req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.042444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7d12d12c1d4bc69d0c3693814e7280', 'request_id': 'req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.060073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7d12d12c1d4bc69d0c3693814e7280', 'request_id': 'req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.091573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] The token cache is being invalidate because project 7a7d12d12c1d4bc69d0c3693814e7280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:24.091869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.092594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.099898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:24.101150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1090/2167] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:23 2022] DELETE /identity/v3/projects/7a7d12d12c1d4bc69d0c3693814e7280 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:24.102252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:24.124648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789c53-4c8e-46d3-ac47-6027c37a72ff admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:24.238708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:24.239749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:24.240194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:24.241049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] PATH_INFO: `/v3/users/415fd79f71ae4433b0eea879fef51f40` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:24.243050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=415fd79f71ae4433b0eea879fef51f40)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:24.245432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:24.493650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415fd79f71ae4433b0eea879fef51f40'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.494586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415fd79f71ae4433b0eea879fef51f40'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.505362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415fd79f71ae4433b0eea879fef51f40'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.521127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415fd79f71ae4433b0eea879fef51f40'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.521878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-cc7a61c5-a380-44b5-9d19-7a447358da8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415fd79f71ae4433b0eea879fef51f40'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:24.523743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:24.634482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1078/2168] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:24 2022] DELETE /identity/v3/users/415fd79f71ae4433b0eea879fef51f40 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:24.996960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:24.999041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:25.038058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c7f29-1dce-4dfe-ac25-4976cc8b9a85 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:25.094498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:25.130833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:25.131781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:25.132604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:25.133148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] PATH_INFO: `/v3/projects/6879c8578b40418baef55c09f85351ad` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:25.134781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6879c8578b40418baef55c09f85351ad)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:25.138278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:25.274194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6879c8578b40418baef55c09f85351ad', 'request_id': 'req-3d8dd85f-3678-41a2-a8f1-a319275645e6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:25.397302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6879c8578b40418baef55c09f85351ad', 'request_id': 'req-3d8dd85f-3678-41a2-a8f1-a319275645e6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:25.405819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6879c8578b40418baef55c09f85351ad', 'request_id': 'req-3d8dd85f-3678-41a2-a8f1-a319275645e6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:25.420165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] The token cache is being invalidate because project 6879c8578b40418baef55c09f85351ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:25.420831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:25.422023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3d8dd85f-3678-41a2-a8f1-a319275645e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:25.430624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:25.431736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:25.432222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:25.437741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1091/2169] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:24 2022] DELETE /identity/v3/projects/6879c8578b40418baef55c09f85351ad => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:25.474486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:25.476252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:25.663870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1079/2170] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:25.669889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:25.670181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:25.670463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:25.733245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:25.735410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:25.744321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1092/2171] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:25.752448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:25.763819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51636a8c-9e09-400d-b466-9f6385df9589 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:25.769407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:25.771611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:25.771611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:25.771611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:25.771611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:25.771868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:25.773556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:25.794345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1080/2172] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:49:25.800939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:25.813069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30eb48-16b5-419c-94bc-cfaeeb5b2051 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:25.818506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:25.819116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:25.819424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:25.819730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:25.820353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:25.822267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:25.922768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1093/2173] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:25 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:25.925363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:25.942092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425317-8950-4142-ad8b-c4d880216281 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:26.028990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:26.030010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.030445 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.030886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.032194 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:26.034153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:26.142670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1081/2174] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:25 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:26.146891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:26.159962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a87999-e511-493b-b64e-73bbfbf7d101 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:26.165001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:26.165882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.166358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.166840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.167727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:26.169442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:26.181417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1094/2175] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:26.185568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:26.196367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbccf-a9e6-4351-b9f2-5927cd289230 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:26.201884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59224ae6-2d0a-41fe-b348-4c4b0de7492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:26.202683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224ae6-2d0a-41fe-b348-4c4b0de7492e admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.207954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224ae6-2d0a-41fe-b348-4c4b0de7492e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.207954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224ae6-2d0a-41fe-b348-4c4b0de7492e admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.207954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59224ae6-2d0a-41fe-b348-4c4b0de7492e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:26.207954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59224ae6-2d0a-41fe-b348-4c4b0de7492e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:26.224199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1082/2176] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:26.225425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:26.237287 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4a77b-d1f6-43db-b4a7-a388a05e0463 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:26.242476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:26.243165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.243537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.243808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] PATH_INFO: `/v3/projects/f0f14c5b0c6742e18830bd51932958be/users/8239c53d1e9d412482865a6677cecf10/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.260443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f14c5b0c6742e18830bd51932958be, user_id=8239c53d1e9d412482865a6677cecf10, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:26.263176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:26.352985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.353468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.353796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.358523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1095/2177] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:26 2022] PUT /identity/v3/projects/f0f14c5b0c6742e18830bd51932958be/users/8239c53d1e9d412482865a6677cecf10/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:26.386538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] MFA Rules not processed for user `8239c53d1e9d412482865a6677cecf10`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:26.387919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:26.458437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:26.489078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:26.491488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1083/2178] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:26.605663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2713da0-a911-4bde-b69e-6404220004bf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:26.611964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:26.612622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.613507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.613507 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.613827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:26.615875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:26.623616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:26.724345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1096/2179] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:26 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:26.727977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:26.755843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e00f34-f289-45aa-b8a6-1fc475dd9d7e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:26.894188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:26.894954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:26.895245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:26.897798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:26.897798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:26.899070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:27.036439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:27.060201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1084/2180] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:26 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:27.064964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af1620-0a7d-4c16-b20d-bc4f2fbae1df admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:27.097641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:27.098450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:27.098750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:27.099105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:27.099795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:27.108426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:27.136089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:27.138298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1097/2181] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:27.162106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96bc8-32d6-46c8-ad91-cfccfa5738e7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:27.169342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:27.170928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:27.179849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:27.179849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] PATH_INFO: `/v3/projects/4b280ae0fb8e403689c0e21c7e1c0128/users/0b7d738e11d64080a2dbb9aa25edcb58/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:27.199001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b280ae0fb8e403689c0e21c7e1c0128, user_id=0b7d738e11d64080a2dbb9aa25edcb58, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:27.204909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:27.297528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1085/2182] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:27 2022] PUT /identity/v3/projects/4b280ae0fb8e403689c0e21c7e1c0128/users/0b7d738e11d64080a2dbb9aa25edcb58/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:27.301971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:27.319710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa1937-8709-417b-9ce3-fe1c7583fc02 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:27.458489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed0045-51d4-4a36-bf7d-eb40fa321af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:27.458790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed0045-51d4-4a36-bf7d-eb40fa321af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:27.459407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed0045-51d4-4a36-bf7d-eb40fa321af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:27.459910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed0045-51d4-4a36-bf7d-eb40fa321af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:27.460659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed0045-51d4-4a36-bf7d-eb40fa321af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:27.462370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed0045-51d4-4a36-bf7d-eb40fa321af8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:27.483302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1098/2183] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:27.490573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:27.517404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053d9f-ab73-4ce4-817f-048690faf829 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:27.522926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:27.524580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:27.526706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:27.526706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] PATH_INFO: `/v3/projects/4b280ae0fb8e403689c0e21c7e1c0128/users/0b7d738e11d64080a2dbb9aa25edcb58/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:27.528003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b280ae0fb8e403689c0e21c7e1c0128, user_id=0b7d738e11d64080a2dbb9aa25edcb58, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:27.533975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:27.566509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1086/2184] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:27 2022] PUT /identity/v3/projects/4b280ae0fb8e403689c0e21c7e1c0128/users/0b7d738e11d64080a2dbb9aa25edcb58/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:27.568833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649449-cd99-4930-a061-97e9decc871c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:27.569225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649449-cd99-4930-a061-97e9decc871c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:27.569745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649449-cd99-4930-a061-97e9decc871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:27.635089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-65649449-cd99-4930-a061-97e9decc871c None None] MFA Rules not processed for user `0b7d738e11d64080a2dbb9aa25edcb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:27.636703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65649449-cd99-4930-a061-97e9decc871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:27.809727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1099/2185] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:27.822780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:27.824867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:28.054641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522fb76-5e20-4b91-9b70-7f7767c515c2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:28.061459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7a631-0495-427e-81fc-73a1dc195b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:28.062895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7a631-0495-427e-81fc-73a1dc195b3c service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:28.064557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7a631-0495-427e-81fc-73a1dc195b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:28.065366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7a631-0495-427e-81fc-73a1dc195b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:28.222415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:28.228521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7a631-0495-427e-81fc-73a1dc195b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:28.230728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7a631-0495-427e-81fc-73a1dc195b3c service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:28.243119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1087/2186] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:29.838621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649449-cd99-4930-a061-97e9decc871c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:29.840376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-65649449-cd99-4930-a061-97e9decc871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:29.983687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:29.992693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649449-cd99-4930-a061-97e9decc871c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:30.001950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:30.002621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:30.003001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:30.003689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] PATH_INFO: `/v3/users/220c9de33f0147318f5f111a27805125` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:30.005182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220c9de33f0147318f5f111a27805125)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:30.007843 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:30.314866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220c9de33f0147318f5f111a27805125'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:30.416660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220c9de33f0147318f5f111a27805125'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:30.466031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220c9de33f0147318f5f111a27805125'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:30.488301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220c9de33f0147318f5f111a27805125'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:30.491166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220c9de33f0147318f5f111a27805125'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:30.522561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1100/2187] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:29 2022] DELETE /identity/v3/users/220c9de33f0147318f5f111a27805125 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:30.528507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:30.532205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:30.533002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:30.595771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:30.598965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:30.736033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1088/2188] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:30.748343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:30.752414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:30.934075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81186-3ef6-4720-8dfe-ab72b97a4d94 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:30.943774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:30.944826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:30.945254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:30.945572 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:30.958971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:30.961223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:30.973212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1101/2189] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:31.545663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:31.549464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:31.568295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865de3d-1ef8-4c4b-9938-18249738e45f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:31.580649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:31.582141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:31.582425 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:31.582895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] PATH_INFO: `/v3/projects/ac7388ce39e244bba3e2048f47fc9921` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:31.589452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7388ce39e244bba3e2048f47fc9921)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:31.591717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:31.714666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7388ce39e244bba3e2048f47fc9921', 'request_id': 'req-93c04c7d-5393-4e4d-af13-1534da3da3e5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:31.722465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7388ce39e244bba3e2048f47fc9921', 'request_id': 'req-93c04c7d-5393-4e4d-af13-1534da3da3e5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:31.728570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7388ce39e244bba3e2048f47fc9921', 'request_id': 'req-93c04c7d-5393-4e4d-af13-1534da3da3e5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:31.800604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] The token cache is being invalidate because project ac7388ce39e244bba3e2048f47fc9921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:31.800604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:31.800604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-93c04c7d-5393-4e4d-af13-1534da3da3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:31.802749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1089/2190] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:31 2022] DELETE /identity/v3/projects/ac7388ce39e244bba3e2048f47fc9921 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:31.806760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:31.821461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d83e2f-4345-448a-bbb9-70dd83fa7495 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:31.903197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4897-7876-4772-886d-227766caada2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:31.903651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4897-7876-4772-886d-227766caada2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:31.903989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4897-7876-4772-886d-227766caada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:31.934208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:31.935529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:31.935964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:31.936570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] PATH_INFO: `/v3/users/70a0eaef066a439dba38a803b32f45f7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:31.938129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a0eaef066a439dba38a803b32f45f7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:31.940283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:31.956053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-74bf4897-7876-4772-886d-227766caada2 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:31.961465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-74bf4897-7876-4772-886d-227766caada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:31.973581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:32.028816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1090/2191] 10.222.0.17 () {58 vars in 967 bytes} [Wed Sep 7 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:32.029915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf4897-7876-4772-886d-227766caada2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:32.032759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-74bf4897-7876-4772-886d-227766caada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:32.061640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf4897-7876-4772-886d-227766caada2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:32.068858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:32.070940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:32.070940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:32.070940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] PATH_INFO: `/v3/users/8239c53d1e9d412482865a6677cecf10` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:32.072282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8239c53d1e9d412482865a6677cecf10)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:32.074305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:32.099870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:32.292720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a0eaef066a439dba38a803b32f45f7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.343704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8239c53d1e9d412482865a6677cecf10'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.344788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8239c53d1e9d412482865a6677cecf10'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.356162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8239c53d1e9d412482865a6677cecf10'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.372068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8239c53d1e9d412482865a6677cecf10'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.373198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-637c3b51-4abe-41a2-9650-6bd210917e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8239c53d1e9d412482865a6677cecf10'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.391543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a0eaef066a439dba38a803b32f45f7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.404538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a0eaef066a439dba38a803b32f45f7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.411578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a0eaef066a439dba38a803b32f45f7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.412251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a0eaef066a439dba38a803b32f45f7'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:32.418238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1102/2192] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:31 2022] DELETE /identity/v3/users/70a0eaef066a439dba38a803b32f45f7 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:32.421355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:32.421355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:32.489798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1091/2193] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:32 2022] DELETE /identity/v3/users/8239c53d1e9d412482865a6677cecf10 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:32.498596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:32.498914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:32.499890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:32.509121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fdde9-1d1e-487a-9a40-1aa1c77fdebe admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:32.530334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:32.532027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:32.576191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:32.576804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:32.577086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:32.577367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:32.579576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:32.592053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1092/2194] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:32.602326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:32.603678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:32.630625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:32.653462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:32.655394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:32.678349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1103/2195] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:49:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:49:32.685639 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df376632-c764-423d-adfb-3f3fd3d9ff08 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:32.692101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303f264-535b-4978-b5d5-dbbf750fe331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:32.692962 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303f264-535b-4978-b5d5-dbbf750fe331 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:32.693317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303f264-535b-4978-b5d5-dbbf750fe331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:32.693806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303f264-535b-4978-b5d5-dbbf750fe331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:32.704082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303f264-535b-4978-b5d5-dbbf750fe331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:32.705534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303f264-535b-4978-b5d5-dbbf750fe331 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:32.715204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1093/2196] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:49:32.889200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:32.890847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:32.904706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740ab06-1cb6-4709-81f6-276fb9365768 service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:32.916406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:32.917343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:32.917536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:32.917881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] PATH_INFO: `/v3/projects/d854c8575f2c422091af8deb0a881129` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:32.919187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d854c8575f2c422091af8deb0a881129)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:32.922937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.064190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd854c8575f2c422091af8deb0a881129', 'request_id': 'req-4843903e-0cbe-4601-902f-9c1f56ca789c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.127818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd854c8575f2c422091af8deb0a881129', 'request_id': 'req-4843903e-0cbe-4601-902f-9c1f56ca789c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.135851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd854c8575f2c422091af8deb0a881129', 'request_id': 'req-4843903e-0cbe-4601-902f-9c1f56ca789c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.150739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] The token cache is being invalidate because project d854c8575f2c422091af8deb0a881129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:33.151033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.151846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.153701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1104/2197] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:32 2022] DELETE /identity/v3/projects/d854c8575f2c422091af8deb0a881129 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:33.159345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a153f3-5df5-4e22-b7ad-6d91d7065b03 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.159665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a153f3-5df5-4e22-b7ad-6d91d7065b03 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.159945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a153f3-5df5-4e22-b7ad-6d91d7065b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.182184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-71a153f3-5df5-4e22-b7ad-6d91d7065b03 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:33.183405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-71a153f3-5df5-4e22-b7ad-6d91d7065b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:33.228029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.229905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:33.235525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:33.277753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1094/2198] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:33.287167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.287355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.287658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.309681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:33.311101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:33.322649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1095/2199] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:33.327975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.355893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2fd2b-f7de-4bf1-a742-46af91d55ebf None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.361440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843903e-0cbe-4601-902f-9c1f56ca789c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.364084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.364773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.365151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.371516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.371516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:33.371516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.371516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.372050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.372050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.372050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.372050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] PATH_INFO: `/v3/projects/f0f14c5b0c6742e18830bd51932958be` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.372329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f14c5b0c6742e18830bd51932958be)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.373579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.383417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1096/2200] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:49:33.386393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.415649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925286-77da-4840-a38f-22f6abbda174 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.415649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.415649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.415649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.416541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.416541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.416541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.489488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f14c5b0c6742e18830bd51932958be', 'request_id': 'req-6ab037ac-ebc1-4fab-b324-154cec67f782'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.509192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1097/2201] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:33 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:33.512593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.556153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f14c5b0c6742e18830bd51932958be', 'request_id': 'req-6ab037ac-ebc1-4fab-b324-154cec67f782'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.563085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f14c5b0c6742e18830bd51932958be', 'request_id': 'req-6ab037ac-ebc1-4fab-b324-154cec67f782'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.565859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:33.574522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539483-11bb-41eb-bd03-5ea3716748c5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.580741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] The token cache is being invalidate because project f0f14c5b0c6742e18830bd51932958be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:33.581253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.581622 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.581899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.582344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.582660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.582938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.585612 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.587779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.600256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1105/2202] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:33 2022] DELETE /identity/v3/projects/f0f14c5b0c6742e18830bd51932958be => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:33.601407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.603069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:33.668708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab037ac-ebc1-4fab-b324-154cec67f782 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.674955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.675772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.676130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.676414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] PATH_INFO: `/v3/users/0b7d738e11d64080a2dbb9aa25edcb58` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.677745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7d738e11d64080a2dbb9aa25edcb58)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.680060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.705749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1098/2203] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:33 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:33.709806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.711657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:33.724835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01af5-be64-4ddc-869f-223331ca749f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.729651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.730249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.730538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.730831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.731499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.733130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.743920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1099/2204] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:33.747743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.757150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076aeb3-1b81-441b-802b-914c267e1437 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.761734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.769004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.769004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.769004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.769004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.769004 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.775708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1100/2205] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:33.780053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:33.791294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131f6c0-e8c1-4d37-be86-ff74614349a8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:33.796195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781a3e3-3062-4cee-81a5-069d606b942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:33.797582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a3e3-3062-4cee-81a5-069d606b942d admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.797850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a3e3-3062-4cee-81a5-069d606b942d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.798125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781a3e3-3062-4cee-81a5-069d606b942d admin admin] PATH_INFO: `/v3/projects/2c06eeeda33d4dcfbf43d1068e99c376/users/fb43c0153865410294918e12993ba06d/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.817295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a3e3-3062-4cee-81a5-069d606b942d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c06eeeda33d4dcfbf43d1068e99c376, user_id=fb43c0153865410294918e12993ba06d, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:33.817521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781a3e3-3062-4cee-81a5-069d606b942d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:33.884047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7d738e11d64080a2dbb9aa25edcb58'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.894719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1101/2206] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:33 2022] PUT /identity/v3/projects/2c06eeeda33d4dcfbf43d1068e99c376/users/fb43c0153865410294918e12993ba06d/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:33.904729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa967-629e-40be-af59-4d1295722407 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:33.905014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa967-629e-40be-af59-4d1295722407 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:33.905312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa967-629e-40be-af59-4d1295722407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:33.938066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d31aa967-629e-40be-af59-4d1295722407 None None] MFA Rules not processed for user `fb43c0153865410294918e12993ba06d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:33.939390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d31aa967-629e-40be-af59-4d1295722407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:33.979027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7d738e11d64080a2dbb9aa25edcb58'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.992650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7d738e11d64080a2dbb9aa25edcb58'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:33.999859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7d738e11d64080a2dbb9aa25edcb58'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.000671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7d738e11d64080a2dbb9aa25edcb58'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.006715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1106/2207] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:33 2022] DELETE /identity/v3/users/0b7d738e11d64080a2dbb9aa25edcb58 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:34.009735 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1102/2208] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:34.013960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.015985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:34.060079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:34.096939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e3508-b0ff-40b8-ab0e-207caadbac69 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.101775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.102392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.102675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.103125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.103773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.105695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.227439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1107/2209] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:34 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:34.231329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aa967-629e-40be-af59-4d1295722407 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.301885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aa967-629e-40be-af59-4d1295722407 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.316486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:34.364290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.364945 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.365289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.365600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.366438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.368749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.464201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.465102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1103/2210] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:34 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:34.466353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.469734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:34.480519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1be14-4d8e-47fd-9caf-15ecf1fc1476 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.485912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.488062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.488062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.488062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.488662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.489961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.492144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2fa3f-ddaa-4967-b375-c03526b0a29d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.500974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.501751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.502109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.502471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] PATH_INFO: `/v3/projects/4b280ae0fb8e403689c0e21c7e1c0128` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.503927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b280ae0fb8e403689c0e21c7e1c0128)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.506300 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.510993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1104/2211] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:34.510993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.530437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd550024-ce4c-464e-ac72-388af0980166 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.536943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.537712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.538003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.538281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] PATH_INFO: `/v3/projects/c7315d9ec59c4869abf44e3a09b7d8b1/users/06701e9bc74d4cabb497dd8360ad0ed9/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.555108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7315d9ec59c4869abf44e3a09b7d8b1, user_id=06701e9bc74d4cabb497dd8360ad0ed9, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.557923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.636828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1105/2212] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:34 2022] PUT /identity/v3/projects/c7315d9ec59c4869abf44e3a09b7d8b1/users/06701e9bc74d4cabb497dd8360ad0ed9/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:34.641531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.645634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b280ae0fb8e403689c0e21c7e1c0128', 'request_id': 'req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.679857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:34.693699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b280ae0fb8e403689c0e21c7e1c0128', 'request_id': 'req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.701695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b280ae0fb8e403689c0e21c7e1c0128', 'request_id': 'req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.711274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c390d65-66ff-4df3-8f57-ad61647a054e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.714644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] The token cache is being invalidate because project 4b280ae0fb8e403689c0e21c7e1c0128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:34.714936 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.715612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:34.717420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1108/2213] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:34 2022] DELETE /identity/v3/projects/4b280ae0fb8e403689c0e21c7e1c0128 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:34.774919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f30ed-317e-44e4-b690-b00e77422fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.775583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f30ed-317e-44e4-b690-b00e77422fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.775872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f30ed-317e-44e4-b690-b00e77422fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.776150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f30ed-317e-44e4-b690-b00e77422fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.776807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f30ed-317e-44e4-b690-b00e77422fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.778422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f30ed-317e-44e4-b690-b00e77422fcf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.791970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1106/2214] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:34.797629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.800517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:34.815237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c175fa9-d35c-40f3-a8f6-5027f7f6bf6c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:34.820503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:34.821216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.821486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.821768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] PATH_INFO: `/v3/projects/c7315d9ec59c4869abf44e3a09b7d8b1/users/06701e9bc74d4cabb497dd8360ad0ed9/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.823850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7315d9ec59c4869abf44e3a09b7d8b1, user_id=06701e9bc74d4cabb497dd8360ad0ed9, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:34.826840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:34.839846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1109/2215] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:34 2022] PUT /identity/v3/projects/c7315d9ec59c4869abf44e3a09b7d8b1/users/06701e9bc74d4cabb497dd8360ad0ed9/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:34.851762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:34.852118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:34.852407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:34.892299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] MFA Rules not processed for user `06701e9bc74d4cabb497dd8360ad0ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:34.893515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:34.973268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1107/2216] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:34.984778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:34.986626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:35.046441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ed4b3-c400-48b9-bd17-fa7ce2cc914b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:35.050044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:35.050646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:35.050928 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:35.051334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:35.062559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:35.064307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:35.075861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1110/2217] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:35.898857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:35.900880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:36.004869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5241-e9da-46e9-b835-7bd5a2cc9112 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:36.009596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:36.010240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:36.010553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:36.010834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] PATH_INFO: `/v3/users/6171a56ade8b47fe95c4ab932bb7e489` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:36.011977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6171a56ade8b47fe95c4ab932bb7e489)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:36.013917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:36.016562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:36.041770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:36.051988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb53494-9b2c-48a1-a80b-dc926a4724ac service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:36.056468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:36.057083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:36.057397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:36.057661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] PATH_INFO: `/v3/users/fb43c0153865410294918e12993ba06d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:36.059115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb43c0153865410294918e12993ba06d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:36.060753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:36.181477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6171a56ade8b47fe95c4ab932bb7e489'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.182078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6171a56ade8b47fe95c4ab932bb7e489'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.190174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6171a56ade8b47fe95c4ab932bb7e489'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.209017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb43c0153865410294918e12993ba06d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.212090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6171a56ade8b47fe95c4ab932bb7e489'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.212863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6171a56ade8b47fe95c4ab932bb7e489'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.293415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb43c0153865410294918e12993ba06d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.306598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:36.309242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb43c0153865410294918e12993ba06d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.317221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb43c0153865410294918e12993ba06d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.317931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-cc58891f-0d87-4497-a7f9-0ec97f556687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb43c0153865410294918e12993ba06d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.323902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1111/2218] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:36 2022] DELETE /identity/v3/users/fb43c0153865410294918e12993ba06d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:36.329037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:36.329037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:36.329037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:36.352897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:36.354148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:36.395253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1108/2219] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:35 2022] DELETE /identity/v3/users/6171a56ade8b47fe95c4ab932bb7e489 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:36.414748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1112/2220] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:36.428753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:36.430254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:36.498356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ee818-82e8-4b28-821b-6ff2ebf48f8d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:36.517142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e3bc6-2b91-4640-9aae-b4bf696d92d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:36.517832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e3bc6-2b91-4640-9aae-b4bf696d92d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:36.518119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e3bc6-2b91-4640-9aae-b4bf696d92d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:36.518810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e3bc6-2b91-4640-9aae-b4bf696d92d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:36.606924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e3bc6-2b91-4640-9aae-b4bf696d92d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:36.608482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e3bc6-2b91-4640-9aae-b4bf696d92d2 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:36.619186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1109/2221] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:36.726809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:36.728355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:36.741256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1853a-8122-4f86-b42e-3909a4ec09e4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:36.747949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:36.748613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:36.748946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:36.749250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] PATH_INFO: `/v3/projects/5c2768f657b041348e7079a2ac0c1b5b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:36.750498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2768f657b041348e7079a2ac0c1b5b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:36.752528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:36.897661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2768f657b041348e7079a2ac0c1b5b', 'request_id': 'req-dc2c0239-50c1-4bf7-9846-549429f3412f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.991362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2768f657b041348e7079a2ac0c1b5b', 'request_id': 'req-dc2c0239-50c1-4bf7-9846-549429f3412f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:36.999609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2768f657b041348e7079a2ac0c1b5b', 'request_id': 'req-dc2c0239-50c1-4bf7-9846-549429f3412f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.012098 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] The token cache is being invalidate because project 5c2768f657b041348e7079a2ac0c1b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:37.012396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.013187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dc2c0239-50c1-4bf7-9846-549429f3412f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.018431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1113/2222] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:36 2022] DELETE /identity/v3/projects/5c2768f657b041348e7079a2ac0c1b5b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:37.020675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.021129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.021272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.043252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:37.044505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.072695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:37.112360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1110/2223] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:37.120920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.121413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.121655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.142962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:37.144375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.153160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.154555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1114/2224] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:37.154686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.158800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.168971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7663d0-292f-4bab-8851-a958195a6eac None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.170582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525c0d4-fb1b-4509-94fd-bb03dc8d0dd0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.174984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.175689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.176029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.178435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.178435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:37.178633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.178907 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.179008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.179008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.179008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] PATH_INFO: `/v3/projects/2c06eeeda33d4dcfbf43d1068e99c376` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.179293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.181234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c06eeeda33d4dcfbf43d1068e99c376)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.183790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.197023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1115/2225] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:49:37.198421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.210866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1cc24-ae9a-441b-b287-46936a5c6287 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.221135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.221758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.222081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.222358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.222995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.224984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.293151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c06eeeda33d4dcfbf43d1068e99c376', 'request_id': 'req-3558b2d7-66eb-4b63-89d3-fbeea95c709a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.300741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c06eeeda33d4dcfbf43d1068e99c376', 'request_id': 'req-3558b2d7-66eb-4b63-89d3-fbeea95c709a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.309625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1116/2226] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:37 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:37.310700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.313833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c06eeeda33d4dcfbf43d1068e99c376', 'request_id': 'req-3558b2d7-66eb-4b63-89d3-fbeea95c709a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.344359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:37.376484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0012a-f5cd-4690-b81f-ce813e714090 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.381201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.381802 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.382085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.382361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.383061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.385027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.390002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] The token cache is being invalidate because project 2c06eeeda33d4dcfbf43d1068e99c376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:37.390487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.391155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.392689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1111/2227] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:37 2022] DELETE /identity/v3/projects/2c06eeeda33d4dcfbf43d1068e99c376 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:37.396730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.398044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.463522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1117/2228] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:37 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:37.464591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.465303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b2d7-66eb-4b63-89d3-fbeea95c709a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.466374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.471136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.471803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.472089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.472381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] PATH_INFO: `/v3/users/06701e9bc74d4cabb497dd8360ad0ed9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.473535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06701e9bc74d4cabb497dd8360ad0ed9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.475488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.479612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e965a-af48-4c99-a21f-8b96c9221ca0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.484679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.485281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.485564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.485840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.486521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.488148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.501565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1118/2229] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:37.502888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.514537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3cf75-8a81-4b7a-a9b2-5d83a3bc8ee9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.520012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.520776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.521063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.521341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.521996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.523672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.535727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1119/2230] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:37.539880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.550051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1761-dd3c-4213-9392-5017422f61e8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.555340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96db23-ba69-44b5-99a0-e0b25ba4f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.555992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96db23-ba69-44b5-99a0-e0b25ba4f541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.556278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96db23-ba69-44b5-99a0-e0b25ba4f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.556560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96db23-ba69-44b5-99a0-e0b25ba4f541 admin admin] PATH_INFO: `/v3/projects/60aa95c6f020485e8fd5067810168ddc/users/55f330b2728f484586053ab82afab181/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.572122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96db23-ba69-44b5-99a0-e0b25ba4f541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60aa95c6f020485e8fd5067810168ddc, user_id=55f330b2728f484586053ab82afab181, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.574774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96db23-ba69-44b5-99a0-e0b25ba4f541 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.597939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06701e9bc74d4cabb497dd8360ad0ed9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.598633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06701e9bc74d4cabb497dd8360ad0ed9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.604052 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:37.606062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06701e9bc74d4cabb497dd8360ad0ed9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.619090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06701e9bc74d4cabb497dd8360ad0ed9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.619949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06701e9bc74d4cabb497dd8360ad0ed9'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:37.636933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1120/2231] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:37 2022] PUT /identity/v3/projects/60aa95c6f020485e8fd5067810168ddc/users/55f330b2728f484586053ab82afab181/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:37.647288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.647503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.647783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.676478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] MFA Rules not processed for user `55f330b2728f484586053ab82afab181`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:37.677727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.694307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1112/2232] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:37 2022] DELETE /identity/v3/users/06701e9bc74d4cabb497dd8360ad0ed9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:37.750661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1121/2233] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:37.761922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.763539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:37.828861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe461b-9db1-4a86-b1b1-6a27c3cdef26 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:37.832631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:37.833254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:37.833542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:37.833834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:37.895797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:37.897231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:37.911231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1113/2234] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:37.949765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:37.951869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.026965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c751c-2ff7-435f-b747-d39cecf7cca0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:38.031339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:38.098444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:38.101910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.101910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.101910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] PATH_INFO: `/v3/users/55f330b2728f484586053ab82afab181` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.101910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f330b2728f484586053ab82afab181)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:38.103184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:38.177430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:38.179237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.197908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49db8-42e8-4f7f-8048-22fdf1eceb9a service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:38.202698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:38.203870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.204031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.204172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] PATH_INFO: `/v3/projects/c7315d9ec59c4869abf44e3a09b7d8b1` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.205325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7315d9ec59c4869abf44e3a09b7d8b1)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:38.207269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:38.315248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f330b2728f484586053ab82afab181'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.592602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7315d9ec59c4869abf44e3a09b7d8b1', 'request_id': 'req-a7038399-b0f3-4fdf-90fa-036622c57517'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.592602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7315d9ec59c4869abf44e3a09b7d8b1', 'request_id': 'req-a7038399-b0f3-4fdf-90fa-036622c57517'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.592602 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7315d9ec59c4869abf44e3a09b7d8b1', 'request_id': 'req-a7038399-b0f3-4fdf-90fa-036622c57517'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.636118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f330b2728f484586053ab82afab181'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.650239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f330b2728f484586053ab82afab181'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.657870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f330b2728f484586053ab82afab181'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.658594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e017bdb2-0aee-4f03-86b3-1567df965f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f330b2728f484586053ab82afab181'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.664797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1122/2235] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:37 2022] DELETE /identity/v3/users/55f330b2728f484586053ab82afab181 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:38.669767 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.670054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.670334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.696397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:38.697639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.778812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1123/2236] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:38.805003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] The token cache is being invalidate because project c7315d9ec59c4869abf44e3a09b7d8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:38.813500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.813500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a7038399-b0f3-4fdf-90fa-036622c57517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:38.813759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:38.813868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1114/2237] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:38 2022] DELETE /identity/v3/projects/c7315d9ec59c4869abf44e3a09b7d8b1 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:38.813984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.817952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb790-eb9c-4df5-9044-a0dd47a0e573 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.818555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb790-eb9c-4df5-9044-a0dd47a0e573 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.818884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afb790-eb9c-4df5-9044-a0dd47a0e573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.844130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:38.847069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-67afb790-eb9c-4df5-9044-a0dd47a0e573 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:38.849143 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-67afb790-eb9c-4df5-9044-a0dd47a0e573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.863533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1115/2238] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:38.868472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.868804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.869173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.881913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a482b21-fd43-47f5-b40a-bf5139412c58 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:38.885991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:38.888052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:38.888052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.888052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.888052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.890738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.902596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:38.904488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:38.908124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:38.915280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:38.915473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1116/2239] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:38.918706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:38.923785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1124/2240] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:38.935441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f2ae-6ac3-45a7-a654-fcc1fda9597c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:38.940963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:38.943914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.943914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.943914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.943914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:38.943914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:38.945509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:38.958677 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1117/2241] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:49:38.970415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:38.981695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14da315-573b-4688-be01-8fe46c2011c6 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:38.991551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:38.991551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:38.991551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:38.991551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:38.992021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:38.993174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.149612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1125/2242] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:38 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:39.152410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.161926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527ae9-f0bf-47ce-9509-94486e751b9b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.222998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.226594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.226594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.226594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.226594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.226968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.319035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1118/2243] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:39.320956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.332685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f4ed-c19e-45ed-872e-2a56dd0b4187 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.337678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.338285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.338570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.338844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.339518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.341128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.352142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1126/2244] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:39.361869 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.375437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3e55a-5c4f-476b-a6d7-5adbea1b9a3c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.378618 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.379252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.379570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.379847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.380662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.382116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.397123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1119/2245] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:39.398709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.402853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.405144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:39.409518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61794f-6d3f-446d-946a-e2b05d9531b7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.414240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4ae30-c20b-4ead-bddb-1e3356ea876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.414900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ae30-c20b-4ead-bddb-1e3356ea876c admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.415665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ae30-c20b-4ead-bddb-1e3356ea876c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.415665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4ae30-c20b-4ead-bddb-1e3356ea876c admin admin] PATH_INFO: `/v3/projects/bef16606301048b99857db03b46fa1a2/users/1dc84b8b5d2845b287f70845c7d518f2/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.427096 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0c96-51e9-48fe-a49b-4bdf001e8b74 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.432974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.433914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.434362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.434741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] PATH_INFO: `/v3/projects/60aa95c6f020485e8fd5067810168ddc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.437221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60aa95c6f020485e8fd5067810168ddc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.439770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.447190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4ae30-c20b-4ead-bddb-1e3356ea876c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef16606301048b99857db03b46fa1a2, user_id=1dc84b8b5d2845b287f70845c7d518f2, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.450705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4ae30-c20b-4ead-bddb-1e3356ea876c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.522410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1127/2246] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:39 2022] PUT /identity/v3/projects/bef16606301048b99857db03b46fa1a2/users/1dc84b8b5d2845b287f70845c7d518f2/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:39.536339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.536629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.536910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.566319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60aa95c6f020485e8fd5067810168ddc', 'request_id': 'req-6d53d387-0df1-4131-9664-a64b9b4d681e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:39.570328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] MFA Rules not processed for user `1dc84b8b5d2845b287f70845c7d518f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:39.571643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:39.572976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60aa95c6f020485e8fd5067810168ddc', 'request_id': 'req-6d53d387-0df1-4131-9664-a64b9b4d681e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:39.579713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60aa95c6f020485e8fd5067810168ddc', 'request_id': 'req-6d53d387-0df1-4131-9664-a64b9b4d681e'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:39.640791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1128/2247] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:39.645384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.676747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] The token cache is being invalidate because project 60aa95c6f020485e8fd5067810168ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:39.677042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:39.677703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6d53d387-0df1-4131-9664-a64b9b4d681e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:39.679254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1120/2248] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:39 2022] DELETE /identity/v3/projects/60aa95c6f020485e8fd5067810168ddc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:39.684298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d75cb-5faf-4af5-b3f8-0ff38b393f2a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.684627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d75cb-5faf-4af5-b3f8-0ff38b393f2a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.684902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d75cb-5faf-4af5-b3f8-0ff38b393f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.705081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0d9d75cb-5faf-4af5-b3f8-0ff38b393f2a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:39.706290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0d9d75cb-5faf-4af5-b3f8-0ff38b393f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:39.712944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b47401-076c-4f3a-8e42-fc7febf22055 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.714470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1121/2249] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:39.717651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.719139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.719361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.719791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.720433 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.722451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.722683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.723009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.723252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.728235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:39.743402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:39.748979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:39.754701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1122/2250] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:39.758748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.767889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca4f5-0eef-476e-9fbb-ae1a943ea1e7 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.772907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.773513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.773800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.774079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.774730 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:39.775037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.776642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.789642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1123/2251] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:49:39.793897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.804557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e979be-e58d-4f40-9fae-971a47890c09 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.809651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.810301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.810585 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.810859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.812085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.813964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.831187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:39.843630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1129/2252] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:39.852290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.852290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:39.912210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9c4c-7222-4219-ab5b-719536f68ac2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:39.916997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:39.917596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:39.917879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:39.918153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:39.918783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:39.920741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:39.927980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1124/2253] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:39.927980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:39.985813 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1130/2254] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:39.989745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.001975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13833648-4da2-4fbb-b478-6ae645f6c83b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.005186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defdae-9e56-4734-b5cf-406a7b224012 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.008148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.008789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.009095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.009370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.010137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.014007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.014163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.014163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.014163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.014163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.015454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.017442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.028206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1131/2255] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:40.032448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.042369 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c9c16-2909-426a-8ae5-c3c0a9e0baf4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.047586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.048216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.048492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.048766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] PATH_INFO: `/v3/projects/3c4c657d03504ea3b34cc4162b8d3346/users/d337c1887bc54f55a1a9bddf31dd8f72/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.064085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4c657d03504ea3b34cc4162b8d3346, user_id=d337c1887bc54f55a1a9bddf31dd8f72, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.066768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.102693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1125/2256] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:39 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:40.103922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.114934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d116d27-cc92-4170-940b-e92c20ef712a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.119661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.129648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.129648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.129648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.129648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.129648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.134457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1126/2257] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:40.138259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.148317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fd9a5-567a-46f9-bdaa-6c050cd0f2b0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.150770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1132/2258] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:40 2022] PUT /identity/v3/projects/3c4c657d03504ea3b34cc4162b8d3346/users/d337c1887bc54f55a1a9bddf31dd8f72/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:40.158131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.210137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.210747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.211033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.211311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.211986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.213571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.224100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1127/2259] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:40.228280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.235519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecb911-d5b1-4634-815d-4bbf4107e680 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.238889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49d7c6-24e4-4176-862f-3628547fdf0c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.240259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.240859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.241219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.241415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.242060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.243705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.246085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d10dc-bf32-4e2d-b7aa-7f8009e0cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.246085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d10dc-bf32-4e2d-b7aa-7f8009e0cc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.246085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d10dc-bf32-4e2d-b7aa-7f8009e0cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.246085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d10dc-bf32-4e2d-b7aa-7f8009e0cc2c admin admin] PATH_INFO: `/v3/projects/ace5063fc5184229b7fc766ed864fa8a/users/e096b4cf45cd44beb53b9faf8b8bf928/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.255714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1133/2260] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:40.259827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.261393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d10dc-bf32-4e2d-b7aa-7f8009e0cc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace5063fc5184229b7fc766ed864fa8a, user_id=e096b4cf45cd44beb53b9faf8b8bf928, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.264074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d10dc-bf32-4e2d-b7aa-7f8009e0cc2c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.269677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a2bc2-5ea0-4eb4-a7cd-76bd2ed44eb9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.274362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecff5d-6c2a-473f-b2c8-c5faf7019d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.275054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecff5d-6c2a-473f-b2c8-c5faf7019d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.275337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecff5d-6c2a-473f-b2c8-c5faf7019d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.280476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecff5d-6c2a-473f-b2c8-c5faf7019d0e admin admin] PATH_INFO: `/v3/projects/3c4c657d03504ea3b34cc4162b8d3346/users/d337c1887bc54f55a1a9bddf31dd8f72/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.280476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecff5d-6c2a-473f-b2c8-c5faf7019d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4c657d03504ea3b34cc4162b8d3346, user_id=d337c1887bc54f55a1a9bddf31dd8f72, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.280476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecff5d-6c2a-473f-b2c8-c5faf7019d0e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.290565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1134/2261] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:40 2022] PUT /identity/v3/projects/3c4c657d03504ea3b34cc4162b8d3346/users/d337c1887bc54f55a1a9bddf31dd8f72/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:40.302788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.303574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.303574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.333918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] MFA Rules not processed for user `d337c1887bc54f55a1a9bddf31dd8f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:40.335174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:40.347969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:40.356058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1128/2262] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:40 2022] PUT /identity/v3/projects/ace5063fc5184229b7fc766ed864fa8a/users/e096b4cf45cd44beb53b9faf8b8bf928/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:40.362070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.362363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.362643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.385118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:40.386067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:40.411920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1135/2263] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:40.424299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.425763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:40.437386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:40.455057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1129/2264] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:40.465053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:40.466406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:40.486066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67b17d-0e75-4562-b145-00ad6a42cfbe None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.528943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3a723-a45f-4539-8c62-7885dd0e3ba1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:40.534312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.535073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.535510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.535965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.538610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29bcc-48ac-4c49-a6e0-0ae6ad925324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:40.539251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29bcc-48ac-4c49-a6e0-0ae6ad925324 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:40.539564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29bcc-48ac-4c49-a6e0-0ae6ad925324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:40.539829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29bcc-48ac-4c49-a6e0-0ae6ad925324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:40.548033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.549596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.559961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1130/2265] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:49:40.607206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb29bcc-48ac-4c49-a6e0-0ae6ad925324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:40.608863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb29bcc-48ac-4c49-a6e0-0ae6ad925324 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:40.619244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1136/2266] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:49:41.652501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:41.662685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0468957-8deb-4f4f-934c-997f7183d02e service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:41.667244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:41.667906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:41.668191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:41.668469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] PATH_INFO: `/v3/users/1dc84b8b5d2845b287f70845c7d518f2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:41.669581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc84b8b5d2845b287f70845c7d518f2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:41.672044 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:41.909652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc84b8b5d2845b287f70845c7d518f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:41.910996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc84b8b5d2845b287f70845c7d518f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:41.937567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc84b8b5d2845b287f70845c7d518f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:41.965242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc84b8b5d2845b287f70845c7d518f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:41.968459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc84b8b5d2845b287f70845c7d518f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:42.038376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1131/2267] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:41 2022] DELETE /identity/v3/users/1dc84b8b5d2845b287f70845c7d518f2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:42.043087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:42.043598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:42.043755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:42.064782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:42.066050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:42.076866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:42.132219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1137/2268] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:42.143550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:42.145265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:42.208892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b8b3-2548-4086-bebd-8743890d5f59 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:42.212758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:42.213518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:42.213860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:42.214196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:42.224679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:42.226058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:42.237080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1132/2269] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:42.680256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:42.681834 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:42.695241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cee3c-0e77-4619-aa23-5c89f1caf915 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:42.711107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:42.712497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:42.712872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:42.713288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] PATH_INFO: `/v3/projects/bef16606301048b99857db03b46fa1a2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:42.715123 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef16606301048b99857db03b46fa1a2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:42.717147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:42.858323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef16606301048b99857db03b46fa1a2', 'request_id': 'req-e8dbdeb1-8380-4330-8a81-b23c46770e88'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:42.950736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef16606301048b99857db03b46fa1a2', 'request_id': 'req-e8dbdeb1-8380-4330-8a81-b23c46770e88'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:42.959440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef16606301048b99857db03b46fa1a2', 'request_id': 'req-e8dbdeb1-8380-4330-8a81-b23c46770e88'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:42.974748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] The token cache is being invalidate because project bef16606301048b99857db03b46fa1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:42.974932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:42.975579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:42.979592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1138/2270] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:42 2022] DELETE /identity/v3/projects/bef16606301048b99857db03b46fa1a2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:42.982469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:42.989641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:42.994169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583dad7-6b52-4c26-a018-a670e30d12d8 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:43.057683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:43.058371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:43.058767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:43.059141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] PATH_INFO: `/v3/users/d337c1887bc54f55a1a9bddf31dd8f72` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:43.060662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d337c1887bc54f55a1a9bddf31dd8f72)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:43.063542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:43.294975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd337c1887bc54f55a1a9bddf31dd8f72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:43.297467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd337c1887bc54f55a1a9bddf31dd8f72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:43.306766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd337c1887bc54f55a1a9bddf31dd8f72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:43.322202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd337c1887bc54f55a1a9bddf31dd8f72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:43.323050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a46a1e4c-6958-4412-a545-d5d8b27efcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd337c1887bc54f55a1a9bddf31dd8f72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:43.413927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1133/2271] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:42 2022] DELETE /identity/v3/users/d337c1887bc54f55a1a9bddf31dd8f72 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:43.918030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:43.920457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:43.940972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdeb1-8380-4330-8a81-b23c46770e88 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.012005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.012807 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.013235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.013587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] PATH_INFO: `/v3/projects/3c4c657d03504ea3b34cc4162b8d3346` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.015614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4c657d03504ea3b34cc4162b8d3346)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.018013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:44.135099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:44.143935 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4c657d03504ea3b34cc4162b8d3346', 'request_id': 'req-4e2d28fb-f09d-4228-a40a-6acb98d30083'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:44.259624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4c657d03504ea3b34cc4162b8d3346', 'request_id': 'req-4e2d28fb-f09d-4228-a40a-6acb98d30083'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:44.267636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4c657d03504ea3b34cc4162b8d3346', 'request_id': 'req-4e2d28fb-f09d-4228-a40a-6acb98d30083'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:44.284396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] The token cache is being invalidate because project 3c4c657d03504ea3b34cc4162b8d3346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:44.284762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:44.285361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4e2d28fb-f09d-4228-a40a-6acb98d30083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:44.291156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1139/2272] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:43 2022] DELETE /identity/v3/projects/3c4c657d03504ea3b34cc4162b8d3346 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:44.297248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.297248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.297248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.318066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:44.319698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:44.389281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1134/2273] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:44.398157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.399185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.399185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.440288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:44.441688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:44.451038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1140/2274] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:44.456525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:44.478499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1da93-fa59-48fc-aa28-2def4872dd8d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.485711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.486333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.486621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.487279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.488050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:44.488548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.490386 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:44.505093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1135/2275] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:49:44.509713 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:44.521121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f133e22-5a54-4f80-bd2e-0d8c07aa74a4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.526457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.527068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.527359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.527663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.528328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.530308 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:44.655207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1141/2276] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:44 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:44.659912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:44.672380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792194d-d092-4da6-a410-9a87f4310d02 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.683766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:44.742408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.743153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.743538 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.744068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.744793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.746963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:44.829731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1136/2277] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:44 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:49:44.830949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:44.842148 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560703-ad11-48b1-9a97-0d01241dc864 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.848263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.848934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.849232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.849505 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.850209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.851932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:44.865605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1142/2278] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:44.867169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:44.878148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714679d-64eb-4b98-9c45-aefefe41b5ac admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.890555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b22c-b081-4238-8471-c95031e448f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.890555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b22c-b081-4238-8471-c95031e448f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.890555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b22c-b081-4238-8471-c95031e448f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.890555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b22c-b081-4238-8471-c95031e448f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.890969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b22c-b081-4238-8471-c95031e448f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.895138 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b22c-b081-4238-8471-c95031e448f9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:44.912436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1137/2279] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:44.915405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:44.926189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943f3dc-9435-48bb-bf7c-cb199279d10e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:44.933116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:44.933915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:44.934268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:44.934639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] PATH_INFO: `/v3/projects/f8638c747bde4470bdc8ec2357ec23b7/users/a12a127c969347cda2066e0e8f953559/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:44.954782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8638c747bde4470bdc8ec2357ec23b7, user_id=a12a127c969347cda2066e0e8f953559, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:44.957971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:45.083470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1143/2280] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:44 2022] PUT /identity/v3/projects/f8638c747bde4470bdc8ec2357ec23b7/users/a12a127c969347cda2066e0e8f953559/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:45.088582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:45.088912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:45.089301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:45.139946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] MFA Rules not processed for user `a12a127c969347cda2066e0e8f953559`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:45.141327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:45.249813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1138/2281] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:45.254408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:45.372004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c5cf-c741-4c18-b12f-c357e312a83e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:45.379168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:45.379168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:45.379168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:45.379168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:45.379630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:45.381388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:45.469118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1144/2282] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:45 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:45.473712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:45.487273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b0bb4-226c-4678-a41f-db411c68c70d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:45.566460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:45.567431 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:45.570163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:45.570163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:45.570163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:45.571473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:45.706546 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1139/2283] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:45 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:45.710635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:45.723940 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f071a37-e230-4364-aacf-5cf603c634ee admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:45.730798 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:45.731650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:45.732613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:45.732931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:45.735095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:45.737153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:45.750126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1145/2284] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:45.759118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:45.764772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843a998-dd26-4bdd-9da6-6949dea7aeb9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:45.769784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:45.770464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:45.770790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:45.771097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] PATH_INFO: `/v3/projects/ba543edb7de14a9fadf7261fd1e4b222/users/2b0f4384a8b14063bb28eccee39aab5b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:45.790439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba543edb7de14a9fadf7261fd1e4b222, user_id=2b0f4384a8b14063bb28eccee39aab5b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:45.793720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:45.813977 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:45.865221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1140/2285] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:45 2022] PUT /identity/v3/projects/ba543edb7de14a9fadf7261fd1e4b222/users/2b0f4384a8b14063bb28eccee39aab5b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:45.869562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:45.880082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2deb9c-c283-49f5-b292-b5488a45d3dc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:45.923594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:45.950419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c22cec-c4dc-49c3-b173-d0f14bc9250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:45.951080 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c22cec-c4dc-49c3-b173-d0f14bc9250c admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:45.951323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c22cec-c4dc-49c3-b173-d0f14bc9250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:45.951637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c22cec-c4dc-49c3-b173-d0f14bc9250c admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:45.952725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c22cec-c4dc-49c3-b173-d0f14bc9250c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:45.955423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c22cec-c4dc-49c3-b173-d0f14bc9250c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:45.967175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1146/2286] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:45.974149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:45.990810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25022-1529-4022-a5d3-10ec9651af9b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:45.998342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:45.999820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:46.000116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:46.000447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] PATH_INFO: `/v3/projects/ba543edb7de14a9fadf7261fd1e4b222/users/2b0f4384a8b14063bb28eccee39aab5b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:46.002953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba543edb7de14a9fadf7261fd1e4b222, user_id=2b0f4384a8b14063bb28eccee39aab5b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:46.005952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:46.029894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1141/2287] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:45 2022] PUT /identity/v3/projects/ba543edb7de14a9fadf7261fd1e4b222/users/2b0f4384a8b14063bb28eccee39aab5b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:46.034476 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:46.034791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:46.035037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:46.075737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] MFA Rules not processed for user `2b0f4384a8b14063bb28eccee39aab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:46.077241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:46.163635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1147/2288] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:46.183544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:46.185346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:46.254828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294193c-3fa0-426b-b570-58690ed29bd5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:46.258583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab8ee8-da17-4a58-8aa3-4d7fbe7e5f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:46.259189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab8ee8-da17-4a58-8aa3-4d7fbe7e5f02 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:46.259502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab8ee8-da17-4a58-8aa3-4d7fbe7e5f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:46.259777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab8ee8-da17-4a58-8aa3-4d7fbe7e5f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:46.269448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab8ee8-da17-4a58-8aa3-4d7fbe7e5f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:46.274986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab8ee8-da17-4a58-8aa3-4d7fbe7e5f02 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:46.280634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1142/2289] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:46.310050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:46.386787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ae1fc-1fbe-48e5-b42f-114c62054246 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:46.392747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:46.393623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:46.394611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:46.394611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] PATH_INFO: `/v3/users/a12a127c969347cda2066e0e8f953559` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:46.400337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12a127c969347cda2066e0e8f953559)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:46.400337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:46.553235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12a127c969347cda2066e0e8f953559'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:46.618614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12a127c969347cda2066e0e8f953559'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:46.632901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12a127c969347cda2066e0e8f953559'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:46.642281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12a127c969347cda2066e0e8f953559'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:46.643577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12a127c969347cda2066e0e8f953559'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:46.657541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1148/2290] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:46 2022] DELETE /identity/v3/users/a12a127c969347cda2066e0e8f953559 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:46.659679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:46.661035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:46.661537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:46.685244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:46.687396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:46.767634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1143/2291] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:46.774426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:46.777584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:46.784506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:46.858758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7a506-bfca-46ed-bc17-af1de3a343c5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:46.861243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6280b1-8e53-455e-98b5-d6176af87e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:46.861865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6280b1-8e53-455e-98b5-d6176af87e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:46.862150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6280b1-8e53-455e-98b5-d6176af87e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:46.862450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6280b1-8e53-455e-98b5-d6176af87e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:46.872335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6280b1-8e53-455e-98b5-d6176af87e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:46.874908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6280b1-8e53-455e-98b5-d6176af87e0d service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:46.886680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1149/2292] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:47.614921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:47.616555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:47.631501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5846a8e-4c89-40df-b62a-f816ff01730d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:47.637704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:47.638989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:47.639528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:47.640451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] PATH_INFO: `/v3/projects/f8638c747bde4470bdc8ec2357ec23b7` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:47.642549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8638c747bde4470bdc8ec2357ec23b7)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:47.645141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:47.677341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:47.678687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:47.679247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:47.732445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] MFA Rules not processed for user `e096b4cf45cd44beb53b9faf8b8bf928`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:47.735588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:47.805764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8638c747bde4470bdc8ec2357ec23b7', 'request_id': 'req-49141446-3409-43b8-9692-0fd2a24111aa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:47.811982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1150/2293] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:47.813384 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8638c747bde4470bdc8ec2357ec23b7', 'request_id': 'req-49141446-3409-43b8-9692-0fd2a24111aa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:47.816564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:47.819996 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8638c747bde4470bdc8ec2357ec23b7', 'request_id': 'req-49141446-3409-43b8-9692-0fd2a24111aa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:47.822711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:47.839783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f26b1-0e23-4166-afdf-5da36ed37dcf None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:47.899449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:47.900066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:47.900355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:47.900621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:47.901251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:47.903161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:47.922913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:47.928510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] The token cache is being invalidate because project f8638c747bde4470bdc8ec2357ec23b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:47.929060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:47.929774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:47.932069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1144/2294] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:47 2022] DELETE /identity/v3/projects/f8638c747bde4470bdc8ec2357ec23b7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:47.935562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:47.937048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:47.950317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49141446-3409-43b8-9692-0fd2a24111aa admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:47.955107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:47.955768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:47.956055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:47.956361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] PATH_INFO: `/v3/users/2b0f4384a8b14063bb28eccee39aab5b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:47.957494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0f4384a8b14063bb28eccee39aab5b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:47.959587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.005131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:48.015916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1151/2295] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:47 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:48.016931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.018549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:48.084242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd22aa-1f26-49ec-8799-1491cbd5054a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.089133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.091049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.091049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.091049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.091049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.093943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.219339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1152/2296] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:48 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:48.223666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.227137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0f4384a8b14063bb28eccee39aab5b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:48.227831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0f4384a8b14063bb28eccee39aab5b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:48.234100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54db46-c607-4a1a-901f-906de2349032 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.235713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0f4384a8b14063bb28eccee39aab5b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:48.238765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.239355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.239661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.240000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.240586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.242184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.248288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0f4384a8b14063bb28eccee39aab5b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:48.249611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0f4384a8b14063bb28eccee39aab5b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:48.254987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1153/2297] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:48.260595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.262327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:48.277994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac4ca-47e6-4511-9d2b-57a1e4e32bb6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.283815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d0298-5453-429c-9281-b0d5443b7373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.284579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0298-5453-429c-9281-b0d5443b7373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.284780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0298-5453-429c-9281-b0d5443b7373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.285051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0298-5453-429c-9281-b0d5443b7373 admin admin] PATH_INFO: `/v3/projects/3ccdd647e83e46c5b1fed4b8723bc26f/users/d1d269f7a7c54ef1b291c8c11ddfe479/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.301334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d0298-5453-429c-9281-b0d5443b7373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccdd647e83e46c5b1fed4b8723bc26f, user_id=d1d269f7a7c54ef1b291c8c11ddfe479, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.304130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d0298-5453-429c-9281-b0d5443b7373 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.345067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1145/2298] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:49:47 2022] DELETE /identity/v3/users/2b0f4384a8b14063bb28eccee39aab5b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:48.380001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1154/2299] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:48 2022] PUT /identity/v3/projects/3ccdd647e83e46c5b1fed4b8723bc26f/users/d1d269f7a7c54ef1b291c8c11ddfe479/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:48.384009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.436404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.436689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.436965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.455406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01cd27-5a04-43da-82d9-15b0a525650d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.458773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:48.460075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:48.520047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.520901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.521191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.521469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.522121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.523268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1155/2300] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:48.523745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.534219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1146/2301] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:48.546964 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.547613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.549366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:48.557631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353232c-d528-4a07-ac73-e6b04313c936 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.580761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.581449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.581733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.582202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] PATH_INFO: `/v3/projects/3ccdd647e83e46c5b1fed4b8723bc26f/users/d1d269f7a7c54ef1b291c8c11ddfe479/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.584150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccdd647e83e46c5b1fed4b8723bc26f, user_id=d1d269f7a7c54ef1b291c8c11ddfe479, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.586828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.598364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1156/2302] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:48 2022] PUT /identity/v3/projects/3ccdd647e83e46c5b1fed4b8723bc26f/users/d1d269f7a7c54ef1b291c8c11ddfe479/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:48.602837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:48.650941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca1a7-85e1-4204-99a7-ce788464a771 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.713598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeecd12-042e-43ca-8a2e-a3237c2dd9c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.714271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeecd12-042e-43ca-8a2e-a3237c2dd9c8 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.714554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeecd12-042e-43ca-8a2e-a3237c2dd9c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.714831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeecd12-042e-43ca-8a2e-a3237c2dd9c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.776615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:48.778490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:48.823226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeecd12-042e-43ca-8a2e-a3237c2dd9c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.825388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeecd12-042e-43ca-8a2e-a3237c2dd9c8 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:48.847224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1147/2303] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:48.860411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:48.884998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa8e1-653a-403e-91b2-e3f478dd0cc9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:48.890862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:48.891665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:48.892985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:48.892985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] PATH_INFO: `/v3/projects/ba543edb7de14a9fadf7261fd1e4b222` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:48.893377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba543edb7de14a9fadf7261fd1e4b222)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:48.895322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.030250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba543edb7de14a9fadf7261fd1e4b222', 'request_id': 'req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:49.136027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba543edb7de14a9fadf7261fd1e4b222', 'request_id': 'req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:49.141215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba543edb7de14a9fadf7261fd1e4b222', 'request_id': 'req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:49.163718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] The token cache is being invalidate because project ba543edb7de14a9fadf7261fd1e4b222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:49:49.164008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:49.165269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-3059b765-00bd-47fe-89bb-4cbb67c2d0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:49:49.169611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1157/2304] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:49:48 2022] DELETE /identity/v3/projects/ba543edb7de14a9fadf7261fd1e4b222 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:49.171472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.171765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.172046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.196094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:49.196870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:49.245715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:49.276055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1148/2305] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:49.281934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.282208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.282489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.308927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:49.310023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:49.323600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1158/2306] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:49.325061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:49.336213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa2c-8381-4428-9630-56c795cc6472 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:49.343330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:49.344058 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.344399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.344682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.345350 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:49:49.345662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:49.347280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.360126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1149/2307] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:49:49.365398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:49.377372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bca5c-b519-4d1c-b81a-103d9a829e99 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:49.382866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:49.383654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.384033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.384968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.385733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:49.388611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.475413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1159/2308] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:49 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:49.477317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:49.488263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10215d21-eac1-4b9f-a00a-fbb872227bf9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:49.549892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:49.550540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.550857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.551246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.551997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:49.554108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.670347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1150/2309] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:49 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:49.675044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:49.685978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2478103-98c0-4162-a195-030a77678e70 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:49.690731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:49.699501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.700294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.701038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.701538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:49.704032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.715277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1160/2310] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:49.720455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:49.731995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e94c3c-1d06-47af-a2f9-aa6c9d42cfbf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:49.738173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67775da-0c2d-46c7-9f2d-39a8c7a3f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:49.738790 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67775da-0c2d-46c7-9f2d-39a8c7a3f9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.739082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67775da-0c2d-46c7-9f2d-39a8c7a3f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.739363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67775da-0c2d-46c7-9f2d-39a8c7a3f9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.740055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67775da-0c2d-46c7-9f2d-39a8c7a3f9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:49.741660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67775da-0c2d-46c7-9f2d-39a8c7a3f9cd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.753632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1151/2311] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:49.758132 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:49.770599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582be2c-a5ab-4c58-b468-04c352d21191 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:49.775709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:49.776377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.776663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.777212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] PATH_INFO: `/v3/projects/55af8dffe10145f3bc1b8315e618de5c/users/d49c4aa6a2b44ba0931079cb5d97724b/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.793132 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55af8dffe10145f3bc1b8315e618de5c, user_id=d49c4aa6a2b44ba0931079cb5d97724b, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:49.797012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:49.905378 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1161/2312] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:49 2022] PUT /identity/v3/projects/55af8dffe10145f3bc1b8315e618de5c/users/d49c4aa6a2b44ba0931079cb5d97724b/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:49:49.916839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:49.917339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:49.917420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:49.950376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] MFA Rules not processed for user `d49c4aa6a2b44ba0931079cb5d97724b`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:49.952043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:50.035334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1152/2313] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:50.039390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:50.123700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bdec7-b8a9-40c1-96f0-3a89bb2ee554 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:50.129010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:50.129432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:50.129752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:50.130023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:50.130808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:50.133065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:50.146002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:50.219170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1162/2314] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:50.223340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:50.237104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199c957-76f1-4ddd-b1f5-76e22598f634 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:50.291403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:50.331773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:50.332417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:50.332708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:50.333341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:50.335861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:50.359117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:50.444964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1153/2315] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:50 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:50.448722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:50.459774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131ea5c-4b92-47fd-9ca7-342a58d7d914 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:50.465431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:50.466131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:50.466497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:50.466772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:50.468017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:50.469641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:50.493778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:50.494332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1163/2316] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:50.507634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c97b9-5041-41be-aeb2-7aea7fdf9e1c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:50.512594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c00e-75f9-47be-b2f7-c9fa4cbbbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:50.513249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c00e-75f9-47be-b2f7-c9fa4cbbbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:50.513701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c00e-75f9-47be-b2f7-c9fa4cbbbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:50.513989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c00e-75f9-47be-b2f7-c9fa4cbbbe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:50.515337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c00e-75f9-47be-b2f7-c9fa4cbbbe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:50.517015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c00e-75f9-47be-b2f7-c9fa4cbbbe2a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:50.529028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1154/2317] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:50.533961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:50.548413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb1cf-5920-4ab4-aa1f-60f2a0cfd797 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:50.553781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:50.559534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:50.559534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:50.559534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] PATH_INFO: `/v3/projects/ea658e4263454625b16c9327991e9cc2/users/4311d48c8e614796987b335ebcbe85d9/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:50.573422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea658e4263454625b16c9327991e9cc2, user_id=4311d48c8e614796987b335ebcbe85d9, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:50.576667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:50.679619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1164/2318] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:50 2022] PUT /identity/v3/projects/ea658e4263454625b16c9327991e9cc2/users/4311d48c8e614796987b335ebcbe85d9/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:50.696552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:50.696921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:50.697419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:50.745986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] MFA Rules not processed for user `4311d48c8e614796987b335ebcbe85d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:50.747986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:50.871064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1155/2319] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:50.876362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:50.995211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999677-3351-4362-9c37-742580bf5415 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:51.001917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:51.002688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.002972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.003328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.004084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:51.006110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:51.134091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1165/2320] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:51.135507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:51.158139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc879540-4550-4ca3-8d67-782511b66c04 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:51.266283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:51.267106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.267548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.273505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.275997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:51.279563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:51.381422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1156/2321] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:49:51 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:49:51.381632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:51.394232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248053e-80e2-4b80-82e3-dc033dc16dcd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:51.400515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:51.401772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.402411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.403038 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.404371 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:51.407736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:51.432994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1166/2322] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:49:51.438020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:51.449476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc404ddc-ccdb-4a4e-bf5c-7a9106463394 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:51.461897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:51.462711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.463069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.463460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] PATH_INFO: `/v3/projects/751b4eb034424f88abe4d026ccc5ff3c/users/09d593a49e7c48379a0bbf6c6b254809/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.488250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=751b4eb034424f88abe4d026ccc5ff3c, user_id=09d593a49e7c48379a0bbf6c6b254809, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:51.492867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:51.576744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1157/2323] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:51 2022] PUT /identity/v3/projects/751b4eb034424f88abe4d026ccc5ff3c/users/09d593a49e7c48379a0bbf6c6b254809/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:51.580800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:51.591756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75406b84-4eee-4ffb-b60b-5c9f58a7df31 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:51.672182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1554ee-0ce1-468e-ab8a-f67a7c5935ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:51.672819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1554ee-0ce1-468e-ab8a-f67a7c5935ca admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.673104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1554ee-0ce1-468e-ab8a-f67a7c5935ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.673388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1554ee-0ce1-468e-ab8a-f67a7c5935ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.674343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1554ee-0ce1-468e-ab8a-f67a7c5935ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:51.676269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1554ee-0ce1-468e-ab8a-f67a7c5935ca admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:51.695901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1167/2324] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:49:51.700842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:51.720950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f434b0f-e527-4ab0-9328-c4d6163730eb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:51.729684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:51.730299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.730588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.730868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] PATH_INFO: `/v3/projects/751b4eb034424f88abe4d026ccc5ff3c/users/09d593a49e7c48379a0bbf6c6b254809/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.733037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751b4eb034424f88abe4d026ccc5ff3c, user_id=09d593a49e7c48379a0bbf6c6b254809, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:51.744496 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:51.755499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:51.773129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1158/2325] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:49:51 2022] PUT /identity/v3/projects/751b4eb034424f88abe4d026ccc5ff3c/users/09d593a49e7c48379a0bbf6c6b254809/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:49:51.776003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c426-f086-4102-9e9c-1a3d5f0c1777 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:51.776003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c426-f086-4102-9e9c-1a3d5f0c1777 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:51.776003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c426-f086-4102-9e9c-1a3d5f0c1777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:51.830069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d6c7c426-f086-4102-9e9c-1a3d5f0c1777 None None] MFA Rules not processed for user `09d593a49e7c48379a0bbf6c6b254809`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:51.832508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d6c7c426-f086-4102-9e9c-1a3d5f0c1777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:51.855800 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:51.964445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1168/2326] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:51.977656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:51.979478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:52.074315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fdf18-63c5-4f85-b309-b0ce9f4fb499 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:52.078485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:52.079549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:52.081009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:52.081521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:52.150282 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:52.152283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:52.166173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1159/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:53.681116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:53.681845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:53.681845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:53.709305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:53.710527 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:53.818193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1169/2328] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:53.841027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:53.842579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:53.991165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f8343-8356-4ea4-9df2-7da3302fe83f service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:53.997731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ee565-faa3-4453-b852-a8c26428f0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:53.998420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee565-faa3-4453-b852-a8c26428f0f4 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:53.999331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee565-faa3-4453-b852-a8c26428f0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:54.000022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee565-faa3-4453-b852-a8c26428f0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:54.017923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ee565-faa3-4453-b852-a8c26428f0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:54.021274 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ee565-faa3-4453-b852-a8c26428f0f4 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:54.042108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1160/2329] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:54.279214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:54.289276 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3094f-ca86-4606-a852-f08208e075d3 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:54.293113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:54.293726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:54.294007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:54.294285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:54.371909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:54.374789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:54.389814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1170/2330] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:54.793314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a7749-c17b-46c8-968a-0f1d85336f5f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:54.797427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a7749-c17b-46c8-968a-0f1d85336f5f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:54.797427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a7749-c17b-46c8-968a-0f1d85336f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:54.828281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-676a7749-c17b-46c8-968a-0f1d85336f5f None None] MFA Rules not processed for user `d1d269f7a7c54ef1b291c8c11ddfe479`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:54.829955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-676a7749-c17b-46c8-968a-0f1d85336f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:54.862897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:54.906930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1161/2331] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:54.919890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:54.922016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:54.986036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509190-e47c-44be-b959-51c7870ea186 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:54.989890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:55.001643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:55.001643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:55.001643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:55.001643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:55.001643 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:55.061419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:55.063484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:55.073590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1171/2332] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:55.375016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:55.375549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:55.375908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:55.399759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:55.401589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:55.494042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1162/2333] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:49:55.518793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:55.520473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:55.592989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb9574-1673-43ed-9ed4-8e0c87e27a5d service glance] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:55.598246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e668b8-4cee-4d20-9eee-bebb516d59e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:55.598871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e668b8-4cee-4d20-9eee-bebb516d59e1 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:55.599146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e668b8-4cee-4d20-9eee-bebb516d59e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:55.599441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e668b8-4cee-4d20-9eee-bebb516d59e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:55.608425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e668b8-4cee-4d20-9eee-bebb516d59e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:55.610072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e668b8-4cee-4d20-9eee-bebb516d59e1 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:55.618390 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1172/2334] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:49:55.933972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:55.946509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010310b-425d-4252-8195-f567f0eb7a3a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:55.954966 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:55.956003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:55.956483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:55.956757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:55.966974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:55.969778 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:56.019069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1163/2335] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:49:59.582792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:59.583566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:59.583566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:59.611711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:49:59.612931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:59.622053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1173/2336] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:49:59.649379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:49:59.652459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:49:59.683473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad680ff9-2315-4cc1-b0dc-4c0dd699f819 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:49:59.690438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1475f9-1a92-4802-aa3d-5d227802c66c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:49:59.692865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1475f9-1a92-4802-aa3d-5d227802c66c service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:49:59.692865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1475f9-1a92-4802-aa3d-5d227802c66c service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:49:59.692865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1475f9-1a92-4802-aa3d-5d227802c66c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:49:59.703697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1475f9-1a92-4802-aa3d-5d227802c66c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:49:59.705353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1475f9-1a92-4802-aa3d-5d227802c66c service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:49:59.718983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1164/2337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:01.258580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:01.269271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef389f81-f30f-4e66-9bd1-7236b30dd14d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:01.288759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:01.288759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:01.288759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:01.288759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] PATH_INFO: `/v3/users/d49c4aa6a2b44ba0931079cb5d97724b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:01.289230 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49c4aa6a2b44ba0931079cb5d97724b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:01.306144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:01.507749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49c4aa6a2b44ba0931079cb5d97724b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:01.555918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49c4aa6a2b44ba0931079cb5d97724b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:01.574562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49c4aa6a2b44ba0931079cb5d97724b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:01.584664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49c4aa6a2b44ba0931079cb5d97724b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:01.585724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49c4aa6a2b44ba0931079cb5d97724b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:01.588949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:01.599955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1174/2338] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:50:01 2022] DELETE /identity/v3/users/d49c4aa6a2b44ba0931079cb5d97724b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:01.601983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:01.602764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:01.603223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:01.625844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:01.627448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:01.703731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1165/2339] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:01.710586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:01.712146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:01.795283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b28d02-52c4-4e22-8ca6-0b3ba3b10b08 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:01.802788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:01.803484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:01.803772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:01.804053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:01.815761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:01.818164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:01.860689 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1175/2340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:02.504183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:02.506290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:02.520892 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e10830-1c7f-4257-b738-c18a0f51d015 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:02.525840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:02.528129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:02.528129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:02.528129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] PATH_INFO: `/v3/projects/55af8dffe10145f3bc1b8315e618de5c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:02.528548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=55af8dffe10145f3bc1b8315e618de5c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:02.530120 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:02.637818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:02.647035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55af8dffe10145f3bc1b8315e618de5c', 'request_id': 'req-e1483eca-e532-41a8-8e72-bf55f9855fac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:02.654485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55af8dffe10145f3bc1b8315e618de5c', 'request_id': 'req-e1483eca-e532-41a8-8e72-bf55f9855fac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:02.660874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55af8dffe10145f3bc1b8315e618de5c', 'request_id': 'req-e1483eca-e532-41a8-8e72-bf55f9855fac'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:02.729762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] The token cache is being invalidate because project 55af8dffe10145f3bc1b8315e618de5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:50:02.730118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:02.730805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e1483eca-e532-41a8-8e72-bf55f9855fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:02.735898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1166/2341] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:50:02 2022] DELETE /identity/v3/projects/55af8dffe10145f3bc1b8315e618de5c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:02.737111 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:02.747920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7e9e5-614a-4fb8-946d-b693a08aff7c service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:02.818631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:02.819291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:02.819625 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:02.819905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] PATH_INFO: `/v3/users/4311d48c8e614796987b335ebcbe85d9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:02.821305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4311d48c8e614796987b335ebcbe85d9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:02.823346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:03.072733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4311d48c8e614796987b335ebcbe85d9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.179286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4311d48c8e614796987b335ebcbe85d9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.194870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4311d48c8e614796987b335ebcbe85d9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.203108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4311d48c8e614796987b335ebcbe85d9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.204087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4311d48c8e614796987b335ebcbe85d9'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.210608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1176/2342] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:50:02 2022] DELETE /identity/v3/users/4311d48c8e614796987b335ebcbe85d9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:03.547254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:03.547903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:03.548405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:03.575430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:03.577356 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:03.664826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1167/2343] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:03.694116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:03.695616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:03.727004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:03.741657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:03.743353 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:03.765755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d2a6-5e43-41d4-bac7-091cf2daa4f6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:03.772627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:03.773393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:03.773747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:03.774094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] PATH_INFO: `/v3/projects/ea658e4263454625b16c9327991e9cc2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:03.775418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea658e4263454625b16c9327991e9cc2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:03.777306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:03.817037 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5a8c-4cf2-4a3e-8cdd-7791e48b70e7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:03.828313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:03.829583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:03.829962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:03.830305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:03.839875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:03.841570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:03.855696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1177/2344] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:03.935310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea658e4263454625b16c9327991e9cc2', 'request_id': 'req-c557e6ec-4a57-4038-a682-428b1f5de261'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.942228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea658e4263454625b16c9327991e9cc2', 'request_id': 'req-c557e6ec-4a57-4038-a682-428b1f5de261'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:03.949938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea658e4263454625b16c9327991e9cc2', 'request_id': 'req-c557e6ec-4a57-4038-a682-428b1f5de261'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.015969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] The token cache is being invalidate because project ea658e4263454625b16c9327991e9cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:50:04.016299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.016995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.022279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1168/2345] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:50:03 2022] DELETE /identity/v3/projects/ea658e4263454625b16c9327991e9cc2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:50:04.023599 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:04.037619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b19025-6e3d-47bd-9fa4-d57edbd5ee4a service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:04.121817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:04.122459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:04.122747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:04.123026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] PATH_INFO: `/v3/users/09d593a49e7c48379a0bbf6c6b254809` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:04.124197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d593a49e7c48379a0bbf6c6b254809)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:04.126818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:04.323286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d593a49e7c48379a0bbf6c6b254809'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.367775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d593a49e7c48379a0bbf6c6b254809'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.384437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d593a49e7c48379a0bbf6c6b254809'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.394358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d593a49e7c48379a0bbf6c6b254809'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.395100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-6ef4aea9-b67a-42d7-b966-61f6ab180395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d593a49e7c48379a0bbf6c6b254809'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:04.401539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1178/2346] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:50:04 2022] DELETE /identity/v3/users/09d593a49e7c48379a0bbf6c6b254809 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:04.824156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:04.826669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:04.843838 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557e6ec-4a57-4038-a682-428b1f5de261 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:04.899475 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:04.910842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:04.911522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:04.911811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:04.912095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] PATH_INFO: `/v3/projects/751b4eb034424f88abe4d026ccc5ff3c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:04.915179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751b4eb034424f88abe4d026ccc5ff3c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:04.917393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:05.037430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751b4eb034424f88abe4d026ccc5ff3c', 'request_id': 'req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:05.045489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751b4eb034424f88abe4d026ccc5ff3c', 'request_id': 'req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:05.056293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751b4eb034424f88abe4d026ccc5ff3c', 'request_id': 'req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:05.118536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] The token cache is being invalidate because project 751b4eb034424f88abe4d026ccc5ff3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:50:05.118766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:05.119524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-178f1c09-7f7b-4316-8a8f-9f8e76f43d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:05.122414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1169/2347] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:50:04 2022] DELETE /identity/v3/projects/751b4eb034424f88abe4d026ccc5ff3c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:05.127406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.128449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.128826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.154825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:05.156697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:05.183412 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:05.234887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1179/2348] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:05.303435 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.303723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.304007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.326292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:05.328213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:05.336748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1170/2349] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:05.343416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:05.352939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d0228-a91a-4672-a386-cd5111f64c4d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:05.357750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:05.358662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.358662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.359208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.360093 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:50:05.360449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:05.362159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:05.397302 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1180/2350] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:50:05.400789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:05.410914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feed191-febf-4a39-af48-1106b7d3a1df None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:05.416839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:05.417454 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.417760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.418055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.418704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:05.420638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:05.707944 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1171/2351] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:50:05 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:50:05.712496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:05.725010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1df60-0007-44db-85ae-f115c06deabc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:05.790817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:05.791460 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.791746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.792027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.792671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:05.794971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:05.932412 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1181/2352] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:50:05 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:50:05.936574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:05.948304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a701-5aec-4406-bb80-9867a06e8794 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:05.954156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:05.963205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.963205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.963205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.963205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:05.963205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:05.969382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1172/2353] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:50:05.973662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:05.985334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89c422-79fd-45d2-bcbd-c2183f05abf2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:05.990419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20732da-8c39-4a9c-98e4-0be1d0ec30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:05.992467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20732da-8c39-4a9c-98e4-0be1d0ec30f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:05.992467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20732da-8c39-4a9c-98e4-0be1d0ec30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:05.992467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20732da-8c39-4a9c-98e4-0be1d0ec30f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:05.992762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20732da-8c39-4a9c-98e4-0be1d0ec30f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:05.994332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20732da-8c39-4a9c-98e4-0be1d0ec30f0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:06.005820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1182/2354] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:50:06.010311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:06.020530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d0a1-a822-4e05-abeb-ccf23a20098f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:06.025212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:06.025858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:06.026173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:06.026452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] PATH_INFO: `/v3/projects/25822dad74504cc6a8104f7232de325e/users/03e3e35c1b214da5a406f87bcf94125e/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:06.041906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25822dad74504cc6a8104f7232de325e, user_id=03e3e35c1b214da5a406f87bcf94125e, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:06.044737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:06.164011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1173/2355] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:50:06 2022] PUT /identity/v3/projects/25822dad74504cc6a8104f7232de325e/users/03e3e35c1b214da5a406f87bcf94125e/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:06.174937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7cb0d-ca29-4d93-9ddf-4eb282ec49e1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:06.175465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7cb0d-ca29-4d93-9ddf-4eb282ec49e1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:06.175581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7cb0d-ca29-4d93-9ddf-4eb282ec49e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:06.209185 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-2ae7cb0d-ca29-4d93-9ddf-4eb282ec49e1 None None] MFA Rules not processed for user `03e3e35c1b214da5a406f87bcf94125e`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:06.210495 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-2ae7cb0d-ca29-4d93-9ddf-4eb282ec49e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:06.311772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1183/2356] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:06.322853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:06.325802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:06.402440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891e6ed-f44f-4baf-b427-80b31a615be3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:06.406558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:06.407279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:06.407624 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:06.407903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:06.416775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:06.418235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:06.428884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1174/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:06.803646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec6f36-7ff1-43d6-94a6-163c5612d40e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:06.803937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec6f36-7ff1-43d6-94a6-163c5612d40e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:06.804217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec6f36-7ff1-43d6-94a6-163c5612d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:06.824304 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7bec6f36-7ff1-43d6-94a6-163c5612d40e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:06.825510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7bec6f36-7ff1-43d6-94a6-163c5612d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:06.846109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:06.901982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1184/2358] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:06.918853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:06.920387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:06.948529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:07.001271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e4191-a4d5-44c0-ad61-4b744bcb92e8 service glance] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:07.006955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:07.007607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:07.007891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:07.008164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:07.017066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:07.018648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:07.027983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1175/2359] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:07.257783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bb8d4-ff93-489a-a9ab-d0c5e8203d22 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:07.258375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bb8d4-ff93-489a-a9ab-d0c5e8203d22 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:07.258375 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bb8d4-ff93-489a-a9ab-d0c5e8203d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:07.278005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f47bb8d4-ff93-489a-a9ab-d0c5e8203d22 None None] MFA Rules not processed for user `e096b4cf45cd44beb53b9faf8b8bf928`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:07.279219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f47bb8d4-ff93-489a-a9ab-d0c5e8203d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:07.336144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1185/2360] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:10.334994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:10.336669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:10.411260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e40bb-ad9c-4f55-a96b-7047086ba326 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:10.416418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:10.417036 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:10.417319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:10.417608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:10.420079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:10.433017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:10.434553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:10.450666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1176/2361] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:11.090239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d56d3d-78c9-4faf-81cc-8e3c446547ff None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:11.090704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d56d3d-78c9-4faf-81cc-8e3c446547ff None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:11.090805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d56d3d-78c9-4faf-81cc-8e3c446547ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:11.111288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-61d56d3d-78c9-4faf-81cc-8e3c446547ff None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:11.114343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-61d56d3d-78c9-4faf-81cc-8e3c446547ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:11.121001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1186/2362] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:11.148681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:11.167941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05dec5-d21e-44de-b85e-00d46fc9da50 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:11.174870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:11.175571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:11.181865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:11.181865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:11.186033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:11.187672 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:11.198081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1177/2363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:13.182536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:13.183024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:13.183196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:13.204290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:13.209656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:13.266251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1187/2364] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:13.278967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:13.280393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:13.354979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5b58e-f240-452f-8572-2021d1590e98 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:13.360800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5754-336e-45e8-b559-440a64bf0b25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:13.361580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5754-336e-45e8-b559-440a64bf0b25 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:13.366381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5754-336e-45e8-b559-440a64bf0b25 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:13.366381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5754-336e-45e8-b559-440a64bf0b25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:13.370464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5754-336e-45e8-b559-440a64bf0b25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:13.372256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5754-336e-45e8-b559-440a64bf0b25 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:13.382339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1178/2365] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:50:23.259583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=70 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:23.378794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:35.655403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:35.668590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106b4e0-d481-405b-86ac-8b5b234d123f None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:35.687559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:35.687559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:35.687559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:35.687559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] PATH_INFO: `/v3/users/03e3e35c1b214da5a406f87bcf94125e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:35.687970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e3e35c1b214da5a406f87bcf94125e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:35.687970 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:35.847903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e3e35c1b214da5a406f87bcf94125e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:35.929789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e3e35c1b214da5a406f87bcf94125e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:35.945521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e3e35c1b214da5a406f87bcf94125e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:35.952726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e3e35c1b214da5a406f87bcf94125e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:35.953691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e3e35c1b214da5a406f87bcf94125e'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:35.964115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1188/2366] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:50:35 2022] DELETE /identity/v3/users/03e3e35c1b214da5a406f87bcf94125e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:35.968469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:35.968950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:35.969043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:35.988652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:35.990341 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:36.052369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1179/2367] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:36.062854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:36.064438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:36.135781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b46b-5080-4b98-9a7b-8be489c3013b admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:36.140297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7430f4-676a-440c-82b9-4beb67b15787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:36.140941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7430f4-676a-440c-82b9-4beb67b15787 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:36.141220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7430f4-676a-440c-82b9-4beb67b15787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:36.141496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7430f4-676a-440c-82b9-4beb67b15787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:36.153301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7430f4-676a-440c-82b9-4beb67b15787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:36.154754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7430f4-676a-440c-82b9-4beb67b15787 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:36.166881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1189/2368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:36.719898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:36.721334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:36.734185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf767b6-f178-4bb7-bf93-a0bdbc64bf4b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:36.739773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:36.740584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:36.748316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:36.748316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] PATH_INFO: `/v3/projects/25822dad74504cc6a8104f7232de325e` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:36.748316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=25822dad74504cc6a8104f7232de325e)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:36.748316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:36.861290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25822dad74504cc6a8104f7232de325e', 'request_id': 'req-b781c97b-2eeb-470c-845e-c2779c2e24ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:36.874821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25822dad74504cc6a8104f7232de325e', 'request_id': 'req-b781c97b-2eeb-470c-845e-c2779c2e24ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:36.876369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25822dad74504cc6a8104f7232de325e', 'request_id': 'req-b781c97b-2eeb-470c-845e-c2779c2e24ab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:36.970379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] The token cache is being invalidate because project 25822dad74504cc6a8104f7232de325e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:50:36.971054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:36.971809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:50:36.982943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1180/2369] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:50:36 2022] DELETE /identity/v3/projects/25822dad74504cc6a8104f7232de325e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:50:40.681023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cefa32-5c70-4316-a44a-8b3113d17a11 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:40.681595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cefa32-5c70-4316-a44a-8b3113d17a11 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:40.681889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cefa32-5c70-4316-a44a-8b3113d17a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:40.704234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d7cefa32-5c70-4316-a44a-8b3113d17a11 None None] MFA Rules not processed for user `8c3c4cc5821742989fd3aebf05fa1acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:40.705451 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d7cefa32-5c70-4316-a44a-8b3113d17a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:40.770553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1190/2370] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:50:46.826216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:50:46.828245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:46.890517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781c97b-2eeb-470c-845e-c2779c2e24ab admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:50:46.894154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:50:46.894769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:46.895082 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:46.895358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:46.897146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:46.950764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:46.981397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:50:46.983076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7a09-c2dc-4f86-b1ba-3e2d032149c8 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:50:47.001455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1181/2371] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:50:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:50:47.274501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b3f5-31e9-4956-b257-b28f87e239a9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:47.275076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b3f5-31e9-4956-b257-b28f87e239a9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:47.275347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b3f5-31e9-4956-b257-b28f87e239a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:47.297127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8f37b3f5-31e9-4956-b257-b28f87e239a9 None None] MFA Rules not processed for user `043a6435674346aaa31dd842f8e12f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:47.298534 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8f37b3f5-31e9-4956-b257-b28f87e239a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:47.324998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:47.372407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1191/2372] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:50:57.586767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=12 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:57.792694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=16 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:59.708478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:50:59.709008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:50:59.709008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:50:59.729251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] MFA Rules not processed for user `4fd98abc30e940728d3810a4369b6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:50:59.730447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:50:59.783545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1182/2373] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:51:02.496236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e004c-91fb-4cb9-96a3-6bb58169b784 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:02.496729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e004c-91fb-4cb9-96a3-6bb58169b784 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:02.496849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e004c-91fb-4cb9-96a3-6bb58169b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:02.517896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a55e004c-91fb-4cb9-96a3-6bb58169b784 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:51:02.519282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a55e004c-91fb-4cb9-96a3-6bb58169b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:02.582761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1192/2374] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:51:02.596599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:02.598117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:02.682941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437067b7-11d5-4db2-9d36-01df81953ea8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:02.688404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:02.689012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:02.689291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:02.689564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:02.697714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:02.699270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:02.708826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1183/2375] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:51:07.108166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591ee8-a1fa-4bfc-b7c6-ab5075a0db09 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:07.108733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591ee8-a1fa-4bfc-b7c6-ab5075a0db09 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:07.109249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591ee8-a1fa-4bfc-b7c6-ab5075a0db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:07.130711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-33591ee8-a1fa-4bfc-b7c6-ab5075a0db09 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:51:07.131976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-33591ee8-a1fa-4bfc-b7c6-ab5075a0db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:07.144374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1193/2376] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:51:07.160285 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:07.161703 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:07.179237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d38c9-6ecc-45b4-8422-867294716fc6 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:07.185782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:07.186958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:07.186958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:07.187155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:07.201897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:07.203748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:07.217434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1184/2377] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:51:09.947183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc104f2-eb95-4e2e-88a7-a09402ece989 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:09.947773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc104f2-eb95-4e2e-88a7-a09402ece989 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:09.948104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc104f2-eb95-4e2e-88a7-a09402ece989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:09.976882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-fdc104f2-eb95-4e2e-88a7-a09402ece989 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:51:09.978372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fdc104f2-eb95-4e2e-88a7-a09402ece989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:09.987327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1194/2378] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:51:10.003286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:10.015992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1426a6-959d-4f4b-ade2-a0f3b773733b service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:10.021414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:10.022021 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:10.022304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:10.022580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:10.032182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:10.033885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:10.047002 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1185/2379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:51:14.209878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205bf20-beb2-4453-912c-d0e90f814bc0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:14.210408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205bf20-beb2-4453-912c-d0e90f814bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:14.210408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205bf20-beb2-4453-912c-d0e90f814bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:14.230261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0205bf20-beb2-4453-912c-d0e90f814bc0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:51:14.231700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0205bf20-beb2-4453-912c-d0e90f814bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:14.239893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1195/2380] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:51:14.260946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:14.272246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639819-e734-49bf-be5b-598993e234f0 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:14.278363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:14.278963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:14.279249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:14.279561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:14.287954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:14.289507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:14.299042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1186/2381] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:51:18.469197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d148-3b4b-49b5-a8ff-1b283da8467e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:18.469699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d148-3b4b-49b5-a8ff-1b283da8467e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:18.469797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d148-3b4b-49b5-a8ff-1b283da8467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:18.489758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1a45d148-3b4b-49b5-a8ff-1b283da8467e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:51:18.490948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1a45d148-3b4b-49b5-a8ff-1b283da8467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:18.499012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1196/2382] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 7 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:51:18.520413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:18.536209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4489be-7fd9-4ece-9d77-70538683a0d3 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:18.542517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:18.543179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:18.543591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:18.543971 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:18.552924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:18.554476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:18.563902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1187/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:51:28.484635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=39 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:28.559716 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=83 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:37.728492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:37.729003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:37.729099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:37.749535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] MFA Rules not processed for user `7207cf1f839b471bb0bff5648534cfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:51:37.750789 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:37.806954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1197/2384] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:51:47.800142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=25 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:54.452304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:54.454600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:51:54.469336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2363-11a8-469e-9e92-50673abd6119 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:54.474660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:54.480110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:54.480110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:54.480110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] PATH_INFO: `/v3/users/8c3c4cc5821742989fd3aebf05fa1acf` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:54.480110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3c4cc5821742989fd3aebf05fa1acf)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:54.480110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:54.709728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3c4cc5821742989fd3aebf05fa1acf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:54.709728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3c4cc5821742989fd3aebf05fa1acf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:54.718415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3c4cc5821742989fd3aebf05fa1acf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:54.736606 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3c4cc5821742989fd3aebf05fa1acf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:54.737390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3c4cc5821742989fd3aebf05fa1acf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:54.807876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1188/2385] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:51:54 2022] DELETE /identity/v3/users/8c3c4cc5821742989fd3aebf05fa1acf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:51:55.303942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:51:55.326511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051240d-fe4a-48d9-a8b2-2055209b0af2 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:51:55.423938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:51:55.424663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:51:55.424942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:51:55.425212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] PATH_INFO: `/v3/projects/2c3529b7253b4befb130c4a6a2b63e5a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:51:55.426557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3529b7253b4befb130c4a6a2b63e5a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:51:55.428699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:51:55.539929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3529b7253b4befb130c4a6a2b63e5a', 'request_id': 'req-47038a33-a3b9-4c6b-80f4-b4c90c115949'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:55.607204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3529b7253b4befb130c4a6a2b63e5a', 'request_id': 'req-47038a33-a3b9-4c6b-80f4-b4c90c115949'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:55.615988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3529b7253b4befb130c4a6a2b63e5a', 'request_id': 'req-47038a33-a3b9-4c6b-80f4-b4c90c115949'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:55.637425 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] The token cache is being invalidate because project 2c3529b7253b4befb130c4a6a2b63e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:51:55.638363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:55.640882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:51:55.647974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1198/2386] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:51:55 2022] DELETE /identity/v3/projects/2c3529b7253b4befb130c4a6a2b63e5a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:04.803832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:05.630223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:06.074232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:06.075762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:06.134504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1b71-7f66-40a3-9917-de9f5926ccc9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:06.186139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:06.186801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:06.187089 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:06.187390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:06.189927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:06.261755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:06.263190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb853-b9b4-4871-8b5e-5539e5c1edf5 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:06.275102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1189/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:07.460900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:07.462351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:07.475058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038a33-a3b9-4c6b-80f4-b4c90c115949 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:07.478665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:07.479497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:07.479779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:07.480048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:07.481775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:07.498424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:07.500385 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:07.513028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1199/2388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:08.059673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:08.060209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:08.060209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:08.080281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] MFA Rules not processed for user `043a6435674346aaa31dd842f8e12f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:08.085331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:08.136459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1190/2389] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:12.293024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:12.299576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:12.317657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfaf5-0e26-45ef-a7ef-1aaaf3515284 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:12.324469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:12.325061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:12.325363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:12.325623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:12.328009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:12.414744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:12.416299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:12.427065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1200/2390] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:17.700109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:17.704927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:17.711001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:17.717351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2019d-d5c8-4b1b-af27-ac0bb9fca4a3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:17.722029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:17.722663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:17.722943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:17.723215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] PATH_INFO: `/v3/users/4fd98abc30e940728d3810a4369b6784` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:17.724406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd98abc30e940728d3810a4369b6784)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:17.726317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:18.020523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd98abc30e940728d3810a4369b6784'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.021177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd98abc30e940728d3810a4369b6784'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.028131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd98abc30e940728d3810a4369b6784'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.040421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd98abc30e940728d3810a4369b6784'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.041060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-75af32fa-e4e6-41bd-b727-1bd5a7735d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd98abc30e940728d3810a4369b6784'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.114867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1191/2391] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:52:17 2022] DELETE /identity/v3/users/4fd98abc30e940728d3810a4369b6784 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:18.599723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:18.615811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c276995-869b-47ef-98d3-d0208c8cabfe service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:18.694270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:18.694924 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:18.695211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:18.695525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] PATH_INFO: `/v3/projects/d37c9fb1839a4ca290d4b2849bb6c1d3` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:18.696707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37c9fb1839a4ca290d4b2849bb6c1d3)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:18.698730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:18.803228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37c9fb1839a4ca290d4b2849bb6c1d3', 'request_id': 'req-625f5f67-2a81-43e9-9194-1824dc90ff60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.888278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37c9fb1839a4ca290d4b2849bb6c1d3', 'request_id': 'req-625f5f67-2a81-43e9-9194-1824dc90ff60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.895316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37c9fb1839a4ca290d4b2849bb6c1d3', 'request_id': 'req-625f5f67-2a81-43e9-9194-1824dc90ff60'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.907055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] The token cache is being invalidate because project d37c9fb1839a4ca290d4b2849bb6c1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:52:18.907480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.908205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-625f5f67-2a81-43e9-9194-1824dc90ff60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:18.910727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1201/2392] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:52:18 2022] DELETE /identity/v3/projects/d37c9fb1839a4ca290d4b2849bb6c1d3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:18.915737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:18.916248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:18.916372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:18.937335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:18.938555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:18.999189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1192/2393] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:19.007146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.007475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.007787 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.029923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:19.035756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:19.040058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1202/2394] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:19.044305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.053853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce0b0-a8f1-4cc5-9bca-313f461e0416 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.058413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.059008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.059291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.059604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.062519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:52:19.062519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.062519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.073953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1193/2395] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:52:19.078281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.084805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:19.089047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2836ed-e33c-46f8-9dec-35365316da28 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.093691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.094296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.094578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.094852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.095529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.098174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.210322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1203/2396] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:52:19 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:52:19.214587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.225828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c4579-1570-4fca-86dc-b1abc92bc868 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.284012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.284625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.284907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.285181 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.285817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.287751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.296436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:19.368948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1194/2397] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:52:19 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:52:19.373087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.383659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f636261-2b4e-4231-80dc-64167b7e91fb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.388365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.389024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.389324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.389604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.390252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.391881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.402252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1204/2398] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:52:19.406231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.416561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b88da0-9b2d-4c2a-bb62-124d14cc1605 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.421366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e581d3a-8e6b-4b8b-aee2-a7d93446548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.421958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e581d3a-8e6b-4b8b-aee2-a7d93446548f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.422241 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e581d3a-8e6b-4b8b-aee2-a7d93446548f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.422516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e581d3a-8e6b-4b8b-aee2-a7d93446548f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.423151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e581d3a-8e6b-4b8b-aee2-a7d93446548f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.425777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e581d3a-8e6b-4b8b-aee2-a7d93446548f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.435779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1195/2399] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:52:19.440153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.450095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436fd61-f7a2-4376-9edb-f3626bbe64d0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.454738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.455972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.456249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.456523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] PATH_INFO: `/v3/projects/2bc07568f6284b2bb34af01c9e04a779/users/9af91bc5d8c04abdb605e513f5a94a2d/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.476748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc07568f6284b2bb34af01c9e04a779, user_id=9af91bc5d8c04abdb605e513f5a94a2d, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.479498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.543488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1205/2400] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:52:19 2022] PUT /identity/v3/projects/2bc07568f6284b2bb34af01c9e04a779/users/9af91bc5d8c04abdb605e513f5a94a2d/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:19.553344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.553659 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.554016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.573516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:19.574708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:19.632731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1196/2401] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:19.642232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.644170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:19.700252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005c95-42d9-45aa-8eae-3d4774ffaae4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.703854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908586b4-9455-4d56-ae4d-9d5faa0cc2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.704453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908586b4-9455-4d56-ae4d-9d5faa0cc2ae service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.704734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908586b4-9455-4d56-ae4d-9d5faa0cc2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.705005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908586b4-9455-4d56-ae4d-9d5faa0cc2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.714945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908586b4-9455-4d56-ae4d-9d5faa0cc2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.716437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908586b4-9455-4d56-ae4d-9d5faa0cc2ae service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.726704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1206/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:19.771279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:19.772682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:19.854998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61432f-b591-46c6-93c5-cc43ccbbd502 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:19.860556 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:19.861160 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:19.861455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:19.861769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:19.863580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:19.926403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:19.928114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:19.937307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1197/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:25.451516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f89e-19c4-4bdc-8466-494adeaab515 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:25.452078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f89e-19c4-4bdc-8466-494adeaab515 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:25.452078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f89e-19c4-4bdc-8466-494adeaab515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:25.501174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b952f89e-19c4-4bdc-8466-494adeaab515 None None] MFA Rules not processed for user `9af91bc5d8c04abdb605e513f5a94a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:25.502553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b952f89e-19c4-4bdc-8466-494adeaab515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:25.627827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1207/2404] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:25.644485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:25.646039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:25.672691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73d19-7dc7-4792-9d7d-781f62eb9ceb service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:25.679733 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:25.680504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:25.680878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:25.681217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:25.691650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:25.694000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:25.719777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1198/2405] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:28.683502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:28.683981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:28.686061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:28.726349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] MFA Rules not processed for user `9af91bc5d8c04abdb605e513f5a94a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:28.728915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:28.746061 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1208/2406] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:29.258583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:29.260927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:29.280862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:29.295415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebee4b-52ab-480e-9d6c-2646261a66a6 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:29.307706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:29.308465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:29.318390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:29.318390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:29.318390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:29.326837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:29.329035 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:29.350981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1199/2407] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:29.810380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:29.815820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:29.866278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:29.921143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4643221-4fe3-40e0-a113-7f5a6b6709de None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:29.930216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:29.930853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:29.931134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:29.931829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:29.933581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:29.947686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:29.953354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:29.961766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1209/2408] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:31.900567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:31.913544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4d70e-4efe-4a22-bbdc-5c49ae8322bf service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:31.919203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:31.919860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:31.920180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:31.920540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:31.922219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:31.982222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:31.983880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837acd2f-9d25-4683-9f45-cba3a0bb5f34 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:31.993851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1200/2409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:34.539739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:34.555398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549645f0-7bd6-43c5-927b-2971f9ed0ebb service placement] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:34.561071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:34.561685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:34.561963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:34.562235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:34.564000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:34.575639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:34.577234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:34.587474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1210/2410] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:35.649599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:35.650067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:35.650168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:35.670802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:35.671998 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:35.725385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1201/2411] 10.222.0.17 () {58 vars in 967 bytes} [Wed Sep 7 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:52:35.765332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:35.766770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:35.841811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea640a-2ead-4a52-929f-8e4f15eca02c service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:35.846953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:35.848209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:35.848491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:35.848791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:35.857686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:35.859330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:35.869192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1211/2412] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:40.780831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:40.782302 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:40.805911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb560c4-daa5-495b-ab7f-dd23bac65dcb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:40.811661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:40.812287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:40.812655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:40.812863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:40.814635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:40.827681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:40.829268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:40.840293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1202/2413] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:45.036960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:45.038424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:45.053041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fc527-7a41-42ca-91c1-0b395c7622ad service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:45.058475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:45.059606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:45.059890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:45.060162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] PATH_INFO: `/v3/users/e096b4cf45cd44beb53b9faf8b8bf928` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:45.061293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e096b4cf45cd44beb53b9faf8b8bf928)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:45.063266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:45.258020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e096b4cf45cd44beb53b9faf8b8bf928'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.334594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e096b4cf45cd44beb53b9faf8b8bf928'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.349346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e096b4cf45cd44beb53b9faf8b8bf928'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.358032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e096b4cf45cd44beb53b9faf8b8bf928'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.358980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e096b4cf45cd44beb53b9faf8b8bf928'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.366699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1212/2414] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:52:45 2022] DELETE /identity/v3/users/e096b4cf45cd44beb53b9faf8b8bf928 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:45.632907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:45.643905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143afc-05ca-47e4-bbeb-bad1e26c8ee7 service placement] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:45.697299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:45.698925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:45.715973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:45.730550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:45.731446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:45.731909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:45.732338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] PATH_INFO: `/v3/projects/ace5063fc5184229b7fc766ed864fa8a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:45.733734 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace5063fc5184229b7fc766ed864fa8a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:45.735860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:45.766536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:45.783796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52518dd1-e5dd-427f-8826-8f8c0e3cdcaf admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:45.790466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:45.791089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:45.791360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:45.791655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:45.793422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:45.806519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:45.808141 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:45.818746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1213/2415] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:45.869813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace5063fc5184229b7fc766ed864fa8a', 'request_id': 'req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.878219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace5063fc5184229b7fc766ed864fa8a', 'request_id': 'req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.903010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace5063fc5184229b7fc766ed864fa8a', 'request_id': 'req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.953132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] The token cache is being invalidate because project ace5063fc5184229b7fc766ed864fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:52:45.953679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.954604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:45.956304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1203/2416] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:52:45 2022] DELETE /identity/v3/projects/ace5063fc5184229b7fc766ed864fa8a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:45.967571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:45.970339 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:45.993348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db011e75-5064-41d2-9431-c1b0989a8d32 service nova] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:46.066205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:46.068027 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:46.068461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:46.068886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] PATH_INFO: `/v3/users/d1d269f7a7c54ef1b291c8c11ddfe479` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:46.070239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d269f7a7c54ef1b291c8c11ddfe479)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:46.072586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:46.338073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d269f7a7c54ef1b291c8c11ddfe479'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.392007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d269f7a7c54ef1b291c8c11ddfe479'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.409138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d269f7a7c54ef1b291c8c11ddfe479'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.418491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d269f7a7c54ef1b291c8c11ddfe479'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.419775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8c447f4b-8d58-4797-b591-066c60b66f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d269f7a7c54ef1b291c8c11ddfe479'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.441257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1214/2417] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:52:45 2022] DELETE /identity/v3/users/d1d269f7a7c54ef1b291c8c11ddfe479 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:46.725224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:46.725224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:46.742323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2de92-9847-4a02-9c2f-3b3aac8a993b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:46.816984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:46.817942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:46.818327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:46.818653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] PATH_INFO: `/v3/projects/3ccdd647e83e46c5b1fed4b8723bc26f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:46.820105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ccdd647e83e46c5b1fed4b8723bc26f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:46.821984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:46.931912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccdd647e83e46c5b1fed4b8723bc26f', 'request_id': 'req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.938576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccdd647e83e46c5b1fed4b8723bc26f', 'request_id': 'req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:46.944934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccdd647e83e46c5b1fed4b8723bc26f', 'request_id': 'req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:47.010189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] The token cache is being invalidate because project 3ccdd647e83e46c5b1fed4b8723bc26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:52:47.010189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:47.010422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-98e0cead-a169-4d24-a0ef-84ad1d8d2fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:52:47.012401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1204/2418] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:52:46 2022] DELETE /identity/v3/projects/3ccdd647e83e46c5b1fed4b8723bc26f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:47.017076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.017373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.017755 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.038700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:47.039961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:47.049577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:47.100621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1215/2419] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:47.108685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.109000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.109279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.129417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:47.130587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:47.138558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1205/2420] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:47.142685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.152348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f63b-fef0-4d4b-89e5-a48c99bd3f31 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.156874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.157468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.157750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.158026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.158669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:52:47.158978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.161321 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.172621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1216/2421] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:52:47.177023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.186809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b522690-8d28-485d-ac48-8799e0669fb5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.191416 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.192013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.192292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.192568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.193198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.195079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.273411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1206/2422] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:52:47 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:52:47.277475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.288396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79176-206c-43ef-ba7d-9c6d63159c55 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.346063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.346665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.346951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.347231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.348458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.350436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.415732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1217/2423] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:52:47 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:52:47.419850 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.430251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2a12-f1dc-41d8-8086-5c1095bd0ef1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.434825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.435453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.435740 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.436046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.436990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.438558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.448379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1207/2424] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:52:47.452271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.463233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb7749-779b-4c77-aa42-5afac73c0725 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.468031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c9062-8da8-4e1e-bced-74d96ba961ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.468623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c9062-8da8-4e1e-bced-74d96ba961ce admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.468936 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c9062-8da8-4e1e-bced-74d96ba961ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.469212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c9062-8da8-4e1e-bced-74d96ba961ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.469884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c9062-8da8-4e1e-bced-74d96ba961ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.471529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c9062-8da8-4e1e-bced-74d96ba961ce admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.483259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1218/2425] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:52:47.487289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.492579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:47.498135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f393-ff0e-4800-9a62-969819325388 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.502772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.503470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.503754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.504059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] PATH_INFO: `/v3/projects/901a8d4d0b384afbb779974c128d1292/users/4931f582f451481ea99bc6d4de78a6bf/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.518144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901a8d4d0b384afbb779974c128d1292, user_id=4931f582f451481ea99bc6d4de78a6bf, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.521489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.574460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1208/2426] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:52:47 2022] PUT /identity/v3/projects/901a8d4d0b384afbb779974c128d1292/users/4931f582f451481ea99bc6d4de78a6bf/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:47.579558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c51ff-6b04-4cbe-a811-7163cb03450e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.579844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c51ff-6b04-4cbe-a811-7163cb03450e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.580120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c51ff-6b04-4cbe-a811-7163cb03450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.599739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-622c51ff-6b04-4cbe-a811-7163cb03450e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:47.600937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-622c51ff-6b04-4cbe-a811-7163cb03450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:47.660048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1219/2427] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:52:47.669755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:47.671474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:47.727681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21474f-3fda-4bbc-bc1c-d2ee894bbb61 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:47.731329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:47.731954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:47.732238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:47.732515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:47.741455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:47.742866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:47.752116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1209/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:52:53.560475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:53.561508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:53.561941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:53.605938 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] MFA Rules not processed for user `4931f582f451481ea99bc6d4de78a6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:52:53.607169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:53.621269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:53.689825 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1220/2429] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:52:53.695197 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:53.705053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac9ff-2f6e-4709-845a-a8d781dc104f service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:53.710822 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:53.711461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:53.711750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:53.712026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:53.712952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:53.714817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:53.798107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1210/2430] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:52:53 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:52:53.802244 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:53.814115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a633b5-4fb9-487d-a2fd-0fbe05f3fb80 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:53.886644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:53.887668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:53.888017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:53.888424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:53.889130 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:53.891531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:53.993179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1221/2431] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:52:53 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:52:53.999076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:54.010845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78704a-7eef-4de5-b79b-59d3f34699fa admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:54.016303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:54.030243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:54.030243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:54.030243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:54.030243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:54.030243 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:54.031289 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1211/2432] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:52:54.035694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:54.046336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893e419-0ac6-4f4a-89bc-41b1372d96cd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:54.052678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:54.053353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:54.053630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:54.053902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] PATH_INFO: `/v3/projects/b30433fcd5d34f30a2bd14d58b93b3f5/users/e4a392d0ae0e4475ba6426552ae8deab/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:54.071616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30433fcd5d34f30a2bd14d58b93b3f5, user_id=e4a392d0ae0e4475ba6426552ae8deab, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:54.074968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:54.176848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1222/2433] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:52:54 2022] PUT /identity/v3/projects/b30433fcd5d34f30a2bd14d58b93b3f5/users/e4a392d0ae0e4475ba6426552ae8deab/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:54.181076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:54.194087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b580d-de27-450f-898d-07c25bf01f98 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:54.274369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:54.275137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:54.275485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:54.275768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:54.276452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:54.278047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:54.289731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1212/2434] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:52:54.293915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:54.304676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156bb6d-3faa-454e-91ea-061883b2d8a0 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:54.309838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b0609-7f07-4cd8-b242-626427dab219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:54.322721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0609-7f07-4cd8-b242-626427dab219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:54.322721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0609-7f07-4cd8-b242-626427dab219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:54.322721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0609-7f07-4cd8-b242-626427dab219 admin admin] PATH_INFO: `/v3/projects/b30433fcd5d34f30a2bd14d58b93b3f5/users/e4a392d0ae0e4475ba6426552ae8deab/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:54.322721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b0609-7f07-4cd8-b242-626427dab219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30433fcd5d34f30a2bd14d58b93b3f5, user_id=e4a392d0ae0e4475ba6426552ae8deab, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:54.322721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b0609-7f07-4cd8-b242-626427dab219 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:54.327859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1223/2435] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:52:54 2022] PUT /identity/v3/projects/b30433fcd5d34f30a2bd14d58b93b3f5/users/e4a392d0ae0e4475ba6426552ae8deab/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:52:56.640391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:52:56.717809 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:56.729154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60fdc-a5a0-4d4b-bacf-d6052ae0bf8f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:52:56.795127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:52:56.795995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:52:56.796441 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:52:56.796865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:52:56.798980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:52:56.950923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:52:56.952738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:52:56.977941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1213/2436] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:01.008809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:01.009408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:01.009408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:01.048106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] MFA Rules not processed for user `e4a392d0ae0e4475ba6426552ae8deab`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:01.049334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:01.129233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:01.151788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1224/2437] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:01.166862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:01.168478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:01.307969 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b030aa5-94b3-4dd6-b9ac-32157b4e905a service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:01.314603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:01.315981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:01.317463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:01.317972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:01.424439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:01.435874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:01.437486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:01.449012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1214/2438] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:01.743699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:01.745420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:01.769329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d78e08-13d3-4b9b-9a00-f5762b5b32fe None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:01.775163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:01.775999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:01.776285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:01.776559 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] PATH_INFO: `/v3/users/7207cf1f839b471bb0bff5648534cfa2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:01.777711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7207cf1f839b471bb0bff5648534cfa2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:01.779673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:01.986983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7207cf1f839b471bb0bff5648534cfa2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.055762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7207cf1f839b471bb0bff5648534cfa2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.069417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7207cf1f839b471bb0bff5648534cfa2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.076296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7207cf1f839b471bb0bff5648534cfa2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.076969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-19ca2853-15d1-405a-80bb-5bc564986b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7207cf1f839b471bb0bff5648534cfa2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.084003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1225/2439] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:01 2022] DELETE /identity/v3/users/7207cf1f839b471bb0bff5648534cfa2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:02.330928 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:02.342389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b124cd-6896-4f09-bb6b-b4e68be4c6cb service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:02.408087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:02.408643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:02.408931 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:02.409211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] PATH_INFO: `/v3/projects/43a3881e45ef47e9b43162089c1273cd` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:02.410329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a3881e45ef47e9b43162089c1273cd)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:02.412264 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:02.536320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a3881e45ef47e9b43162089c1273cd', 'request_id': 'req-f26f6316-8998-479d-92ee-65af17bcf538'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.542652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a3881e45ef47e9b43162089c1273cd', 'request_id': 'req-f26f6316-8998-479d-92ee-65af17bcf538'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.548097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a3881e45ef47e9b43162089c1273cd', 'request_id': 'req-f26f6316-8998-479d-92ee-65af17bcf538'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.615359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] The token cache is being invalidate because project 43a3881e45ef47e9b43162089c1273cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:02.615678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.616301 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f26f6316-8998-479d-92ee-65af17bcf538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:02.617774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1215/2440] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:02 2022] DELETE /identity/v3/projects/43a3881e45ef47e9b43162089c1273cd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:02.622832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:02.623213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:02.623568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:02.643734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:02.644973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:02.706965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1226/2441] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:02.715066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:02.715922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:02.716223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:02.736594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:02.737861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:02.746623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1216/2442] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:02.750879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:02.761770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a503f93-e2ca-44fa-a3d8-2f2db9a82219 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:02.766343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:02.766949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:02.767228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:02.767626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:02.768275 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:02.768580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:02.770267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:02.782104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1227/2443] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:02.792665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:02.803221 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50c258-1fc9-48e7-89f1-084369f1b9b1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:02.807876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:02.808468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:02.808750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:02.809023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:02.809666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:02.811726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:02.903903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1217/2444] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:02 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:53:02.908876 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:02.918922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce33a-35d0-4c9d-a7a3-8ce461bef258 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:02.975730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:02.988338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:02.996029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:02.996029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:02.996029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:02.996029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:02.996029 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.062985 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1228/2445] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:02 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:03.066870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.078601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72b367-e035-44b7-b3eb-62d8ee65013f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.084086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.084700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.090713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.090713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.090713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.090713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.102023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1218/2446] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:03.103161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.114903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f7ec-a27b-4a78-aa4c-912e7511b6ff admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.120134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7f9fc-2b5b-4bd5-92c2-d5963cac90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.120742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7f9fc-2b5b-4bd5-92c2-d5963cac90d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.121023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7f9fc-2b5b-4bd5-92c2-d5963cac90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.121295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7f9fc-2b5b-4bd5-92c2-d5963cac90d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.121933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7f9fc-2b5b-4bd5-92c2-d5963cac90d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.123721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7f9fc-2b5b-4bd5-92c2-d5963cac90d4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.136781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1229/2447] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:03.139875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.150986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cda793-b89f-4b43-95fb-c968180ee84b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.159836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.159836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.159836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.159836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] PATH_INFO: `/v3/projects/cfe638d95f744232911e0895f2f5d6c4/users/6520bd2d159543eab692efe84bc0dad1/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.173100 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe638d95f744232911e0895f2f5d6c4, user_id=6520bd2d159543eab692efe84bc0dad1, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.175826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.263833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1219/2448] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:03 2022] PUT /identity/v3/projects/cfe638d95f744232911e0895f2f5d6c4/users/6520bd2d159543eab692efe84bc0dad1/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:03.276540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.277023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.277455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.331573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] MFA Rules not processed for user `6520bd2d159543eab692efe84bc0dad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:03.334753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:03.409977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1230/2449] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:03.414834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.432525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:03.482932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9037ed-e151-4083-8c8b-5317c15e12e2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.487777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.488385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.488715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.489014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.489871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.491804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.593712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1220/2450] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:03 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:03.597859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.608808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0799d0-97ff-458d-948b-6d709d1f6210 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.670580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.670718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.671231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.671430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.672087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.674175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.786514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1231/2451] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:03 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:03.792279 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.803488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4b67-af60-4db1-926a-4517a45ea5c8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.808965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.809371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.809654 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.809926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.810875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.812501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.824158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1221/2452] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:03.828319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.842107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31fbe-d99c-4e59-a67a-1a58b81449a9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:03.847316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936dad3-2c78-4bfa-8fc9-f6596aefc096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:03.848086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dad3-2c78-4bfa-8fc9-f6596aefc096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:03.848283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dad3-2c78-4bfa-8fc9-f6596aefc096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:03.848563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dad3-2c78-4bfa-8fc9-f6596aefc096 admin admin] PATH_INFO: `/v3/projects/de00ecff93dc4b59a6c932f748d137ed/users/1f6a3174165c4201bc5101c8290b5e5f/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:03.865280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dad3-2c78-4bfa-8fc9-f6596aefc096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de00ecff93dc4b59a6c932f748d137ed, user_id=1f6a3174165c4201bc5101c8290b5e5f, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:03.869744 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dad3-2c78-4bfa-8fc9-f6596aefc096 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:03.970722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1232/2453] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:03 2022] PUT /identity/v3/projects/de00ecff93dc4b59a6c932f748d137ed/users/1f6a3174165c4201bc5101c8290b5e5f/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:03.975942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:03.999360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608326-a22e-4c0e-bd30-6cc0ed280467 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:04.055568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:04.056183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:04.056467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:04.056744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:04.057515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:04.059156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:04.070108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:04.070646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:04.070646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:04.077418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1222/2454] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:04.078420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:04.089697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd0d9-4c33-4b54-ba1a-f9d80a88842c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:04.093415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] MFA Rules not processed for user `4931f582f451481ea99bc6d4de78a6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:04.094824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dd502-9c62-4a80-b133-3f1b2fa4ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:04.095003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:04.095519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd502-9c62-4a80-b133-3f1b2fa4ebde admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:04.095807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd502-9c62-4a80-b133-3f1b2fa4ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:04.096148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd502-9c62-4a80-b133-3f1b2fa4ebde admin admin] PATH_INFO: `/v3/projects/de00ecff93dc4b59a6c932f748d137ed/users/1f6a3174165c4201bc5101c8290b5e5f/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:04.098061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dd502-9c62-4a80-b133-3f1b2fa4ebde admin admin] RBAC: Authorizing `identity:create_grant(project_id=de00ecff93dc4b59a6c932f748d137ed, user_id=1f6a3174165c4201bc5101c8290b5e5f, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:04.100933 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dd502-9c62-4a80-b133-3f1b2fa4ebde admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:04.112909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1223/2455] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:04 2022] PUT /identity/v3/projects/de00ecff93dc4b59a6c932f748d137ed/users/1f6a3174165c4201bc5101c8290b5e5f/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:04.113749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:04.123470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:04.123758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:04.125072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:04.154363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1233/2456] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:04.155233 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] MFA Rules not processed for user `1f6a3174165c4201bc5101c8290b5e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:04.156701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:04.223793 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:04.233476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1224/2457] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:04.245656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:04.247194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:04.313207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b237-fed4-4dba-b14b-bde50e9d99c7 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:04.371817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7eacd-1bf5-4fce-b5d2-2ce34a5c0c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:04.372676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7eacd-1bf5-4fce-b5d2-2ce34a5c0c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:04.373386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7eacd-1bf5-4fce-b5d2-2ce34a5c0c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:04.373520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7eacd-1bf5-4fce-b5d2-2ce34a5c0c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:04.385821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7eacd-1bf5-4fce-b5d2-2ce34a5c0c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:04.388360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7eacd-1bf5-4fce-b5d2-2ce34a5c0c52 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:04.400139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1234/2458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:07.728562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:07.797346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2af34-792f-496d-8eae-3b0e851dcfc0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:07.802313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:07.802993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:07.803275 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:07.803589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] PATH_INFO: `/v3/users/6520bd2d159543eab692efe84bc0dad1` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:07.804727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6520bd2d159543eab692efe84bc0dad1)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:07.806642 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:07.973746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6520bd2d159543eab692efe84bc0dad1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:07.976537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6520bd2d159543eab692efe84bc0dad1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:07.984889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6520bd2d159543eab692efe84bc0dad1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:07.998199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6520bd2d159543eab692efe84bc0dad1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:07.998923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6520bd2d159543eab692efe84bc0dad1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:08.076861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1225/2459] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:07 2022] DELETE /identity/v3/users/6520bd2d159543eab692efe84bc0dad1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:08.083888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:08.084383 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:08.085036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:08.112547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:08.112547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:08.184157 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1235/2460] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:08.194766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:08.196210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:08.265404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42418e3-a98a-4e0d-ba81-111e30f1fac1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:08.269281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:08.269896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:08.270315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:08.270792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:08.280313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:08.281737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:08.294210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1226/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:09.018959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:09.020831 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:09.041714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff959d-dbab-40a1-ba39-1df662909440 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:09.048742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:09.049370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:09.049659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:09.049941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] PATH_INFO: `/v3/projects/cfe638d95f744232911e0895f2f5d6c4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:09.051967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe638d95f744232911e0895f2f5d6c4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:09.056595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:09.079036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:09.193365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe638d95f744232911e0895f2f5d6c4', 'request_id': 'req-95cca175-9e39-448e-8e98-de627fea8f09'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.291829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe638d95f744232911e0895f2f5d6c4', 'request_id': 'req-95cca175-9e39-448e-8e98-de627fea8f09'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.304883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe638d95f744232911e0895f2f5d6c4', 'request_id': 'req-95cca175-9e39-448e-8e98-de627fea8f09'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.345583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] The token cache is being invalidate because project cfe638d95f744232911e0895f2f5d6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:09.346682 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.347666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.350235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1236/2462] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:09 2022] DELETE /identity/v3/projects/cfe638d95f744232911e0895f2f5d6c4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:09.354549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:09.366503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fb79-b4b4-4c73-8f8f-0352c8b7db80 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:09.379490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:09.431947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:09.432595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:09.432883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:09.433162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] PATH_INFO: `/v3/users/1f6a3174165c4201bc5101c8290b5e5f` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:09.434292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6a3174165c4201bc5101c8290b5e5f)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:09.436318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:09.681695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6a3174165c4201bc5101c8290b5e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.682379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6a3174165c4201bc5101c8290b5e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.689309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6a3174165c4201bc5101c8290b5e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.702348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6a3174165c4201bc5101c8290b5e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.703161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d669feb7-f907-4bfe-af23-11a2c9fe7e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6a3174165c4201bc5101c8290b5e5f'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:09.774610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1227/2463] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:09 2022] DELETE /identity/v3/users/1f6a3174165c4201bc5101c8290b5e5f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:10.298347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:10.300000 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:10.319859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca175-9e39-448e-8e98-de627fea8f09 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:10.390200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:10.390200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:10.390200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:10.390200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] PATH_INFO: `/v3/projects/de00ecff93dc4b59a6c932f748d137ed` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:10.390600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de00ecff93dc4b59a6c932f748d137ed)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:10.390600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:10.491259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de00ecff93dc4b59a6c932f748d137ed', 'request_id': 'req-938e1111-1df2-4c81-be92-7801e2de1864'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:10.556515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de00ecff93dc4b59a6c932f748d137ed', 'request_id': 'req-938e1111-1df2-4c81-be92-7801e2de1864'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:10.563018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de00ecff93dc4b59a6c932f748d137ed', 'request_id': 'req-938e1111-1df2-4c81-be92-7801e2de1864'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:10.574551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] The token cache is being invalidate because project de00ecff93dc4b59a6c932f748d137ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:10.574842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:10.575533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-938e1111-1df2-4c81-be92-7801e2de1864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:10.577022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1237/2464] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:10 2022] DELETE /identity/v3/projects/de00ecff93dc4b59a6c932f748d137ed => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:10.582029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:10.582539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:10.583190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:10.604478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:10.605708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:10.666139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1228/2465] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:10.673993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:10.674282 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:10.674557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:10.694786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:10.696040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:10.703888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1238/2466] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:10.708988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:10.719146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb252-af0b-40dd-af66-8583e75d34cf None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:10.723978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:10.724610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:10.724899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:10.725179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:10.725953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:10.726293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:10.728325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:10.741893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1229/2467] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:10.746397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:10.755966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23cd35-832a-4828-9d65-2a431689be96 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:10.763492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:10.764510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:10.765002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:10.765483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:10.766628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:10.770756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:10.901564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1239/2468] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:10 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:10.905641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:10.915783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f63d10-d1f5-4255-a7e3-76c7acb219ad admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:10.937686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:10.979766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:10.980695 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:10.980972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:10.981310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:10.981947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:10.983946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.117954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1230/2469] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:10 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:11.122166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.133182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475413-e2fe-478d-b944-0aeea7cd6743 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.137806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.138399 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.138681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.138957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.139630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.141341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.147493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:11.160360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1240/2470] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:11.160573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.167075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c908-9511-48b8-9fda-bb2c4c8c0020 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.171711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562d7a2-6e63-489c-8e52-782aef2584f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.172367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562d7a2-6e63-489c-8e52-782aef2584f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.172674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562d7a2-6e63-489c-8e52-782aef2584f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.172935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562d7a2-6e63-489c-8e52-782aef2584f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.173607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562d7a2-6e63-489c-8e52-782aef2584f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.175184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562d7a2-6e63-489c-8e52-782aef2584f3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.186265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1231/2471] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:11.190365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.201748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091cf1d-e1a2-495a-99e0-8c0b3cc85a50 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.207168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.208048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.208376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.208657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] PATH_INFO: `/v3/projects/621eda8665714fe3a210098a6ea748a6/users/45b9d4c1133e40bf88fbb67ca142145b/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.223441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621eda8665714fe3a210098a6ea748a6, user_id=45b9d4c1133e40bf88fbb67ca142145b, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.226177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.307520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1241/2472] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:11 2022] PUT /identity/v3/projects/621eda8665714fe3a210098a6ea748a6/users/45b9d4c1133e40bf88fbb67ca142145b/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:11.321611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.321965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.322306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.352389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] MFA Rules not processed for user `45b9d4c1133e40bf88fbb67ca142145b`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:11.353600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:11.429950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1232/2473] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:11.431297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.506854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692ca3f-c351-4203-9b86-56f809ff03a4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.511837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.512920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.512920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.513131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.513683 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.515899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.593638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1242/2474] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:11 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:11.594797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.605684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cb916-0f12-4138-8e1b-c8f6abaf7d9f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.665794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.666395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.666687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.666947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.667613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.669539 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.774628 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1233/2475] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:11 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:11.778441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.789441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8627-1ab8-4fb3-9534-014f49749939 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.794107 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.795569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.795569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.795569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.795895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.797496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.808972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1243/2476] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:11.813127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.823947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f7596-73b3-415d-a70e-b61377f09b20 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:11.828871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:11.829558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:11.829872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:11.830218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] PATH_INFO: `/v3/projects/06f91a55a1d04babb9d1399378802ad8/users/d33d569845564f73869dfa2153d896b1/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:11.846270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f91a55a1d04babb9d1399378802ad8, user_id=d33d569845564f73869dfa2153d896b1, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:11.850017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:11.936507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:11.944779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1234/2477] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:11 2022] PUT /identity/v3/projects/06f91a55a1d04babb9d1399378802ad8/users/d33d569845564f73869dfa2153d896b1/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:11.948765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:11.960636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea0585-36a8-4699-bb1f-4626dacf2904 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:12.021971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17df5e-2982-4c98-995a-4ab2db1ee3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:12.022578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17df5e-2982-4c98-995a-4ab2db1ee3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:12.022874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17df5e-2982-4c98-995a-4ab2db1ee3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:12.023125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17df5e-2982-4c98-995a-4ab2db1ee3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:12.023796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17df5e-2982-4c98-995a-4ab2db1ee3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:12.025456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17df5e-2982-4c98-995a-4ab2db1ee3c8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:12.039500 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1244/2478] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:12.040832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:12.052607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ee66-8d02-4e1d-8a5a-fa800850fd4e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:12.058845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:12.059586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:12.059871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:12.060154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] PATH_INFO: `/v3/projects/06f91a55a1d04babb9d1399378802ad8/users/d33d569845564f73869dfa2153d896b1/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:12.062190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f91a55a1d04babb9d1399378802ad8, user_id=d33d569845564f73869dfa2153d896b1, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:12.064906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:12.086799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1235/2479] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:12 2022] PUT /identity/v3/projects/06f91a55a1d04babb9d1399378802ad8/users/d33d569845564f73869dfa2153d896b1/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:12.088945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:12.089221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:12.089499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:12.119360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] MFA Rules not processed for user `d33d569845564f73869dfa2153d896b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:12.120694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:12.161687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:12.202088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1245/2480] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:12.212245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:12.214234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:12.278084 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e688aa-3e1e-41ed-8cad-03e12379ab6f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:12.281707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:12.282909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:12.282909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:12.282909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:12.292791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:12.294284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:12.304307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1236/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:12.415756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:12.417388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:12.429810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e547d-7e29-4e70-b4a2-198adfa59cfd None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:12.433454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc9dbe-edad-41a4-863f-f415819ddd50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:12.437862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9dbe-edad-41a4-863f-f415819ddd50 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:12.437862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9dbe-edad-41a4-863f-f415819ddd50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:12.437862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9dbe-edad-41a4-863f-f415819ddd50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:12.537836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9dbe-edad-41a4-863f-f415819ddd50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:12.537836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9dbe-edad-41a4-863f-f415819ddd50 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:12.543824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1246/2482] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:17.841823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:17.903868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6cdb-7c50-4ebb-8661-eaddf847940f service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:17.908526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:17.909147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:17.909432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:17.909710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] PATH_INFO: `/v3/users/45b9d4c1133e40bf88fbb67ca142145b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:17.910833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b9d4c1133e40bf88fbb67ca142145b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:17.913451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:18.104750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b9d4c1133e40bf88fbb67ca142145b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:18.105460 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b9d4c1133e40bf88fbb67ca142145b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:18.112497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b9d4c1133e40bf88fbb67ca142145b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:18.125383 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b9d4c1133e40bf88fbb67ca142145b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:18.126078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b9d4c1133e40bf88fbb67ca142145b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:18.197700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1237/2483] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:17 2022] DELETE /identity/v3/users/45b9d4c1133e40bf88fbb67ca142145b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:18.202207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:18.202677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:18.202794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:18.222840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:18.224060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:18.283597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1247/2484] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:18.293307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:18.294638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:18.304337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:18.352268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2082c3-5c55-463b-8ad9-84ac17fe7212 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:18.355953 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:18.356557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:18.356844 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:18.357124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:18.366167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:18.367698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:18.377493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1238/2485] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:18.802677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:18.802677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:18.814089 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f0307-b9ae-4cff-91d1-c886688394a9 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:18.818954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:18.819628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:18.820877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:18.821251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] PATH_INFO: `/v3/projects/621eda8665714fe3a210098a6ea748a6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:18.822421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=621eda8665714fe3a210098a6ea748a6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:18.824671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:18.955280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621eda8665714fe3a210098a6ea748a6', 'request_id': 'req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.008745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621eda8665714fe3a210098a6ea748a6', 'request_id': 'req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.018513 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621eda8665714fe3a210098a6ea748a6', 'request_id': 'req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.019723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:19.030581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] The token cache is being invalidate because project 621eda8665714fe3a210098a6ea748a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:19.030873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.031596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.034841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1248/2486] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:18 2022] DELETE /identity/v3/projects/621eda8665714fe3a210098a6ea748a6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:19.037226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:19.047614 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e049b9f-2bd3-471a-9b36-818bcf0aa633 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:19.107023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:19.107621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:19.107908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:19.108186 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] PATH_INFO: `/v3/users/d33d569845564f73869dfa2153d896b1` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:19.109308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33d569845564f73869dfa2153d896b1)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:19.111293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:19.344494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33d569845564f73869dfa2153d896b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.345175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33d569845564f73869dfa2153d896b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.353781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33d569845564f73869dfa2153d896b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.365784 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33d569845564f73869dfa2153d896b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.366380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33d569845564f73869dfa2153d896b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:19.455655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1239/2487] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:19 2022] DELETE /identity/v3/users/d33d569845564f73869dfa2153d896b1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:19.897594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:19.900750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:19.913054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530390-3f49-42e9-8c5b-e7117dfa2bfc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:19.992984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32504908-4b15-412f-b434-e01312da301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:19.993707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32504908-4b15-412f-b434-e01312da301f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:19.994067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32504908-4b15-412f-b434-e01312da301f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:19.994465 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32504908-4b15-412f-b434-e01312da301f admin admin] PATH_INFO: `/v3/projects/06f91a55a1d04babb9d1399378802ad8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:19.995742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32504908-4b15-412f-b434-e01312da301f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f91a55a1d04babb9d1399378802ad8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:19.997870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32504908-4b15-412f-b434-e01312da301f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.069825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.072081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:20.104867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:20.130247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7b726-0f5c-4dcb-ac88-244b98f40886 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.134607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.135278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.145440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.145440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.145440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:20.156086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.158331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.160327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-32504908-4b15-412f-b434-e01312da301f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f91a55a1d04babb9d1399378802ad8', 'request_id': 'req-32504908-4b15-412f-b434-e01312da301f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:20.170937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1240/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:20.262201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-32504908-4b15-412f-b434-e01312da301f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f91a55a1d04babb9d1399378802ad8', 'request_id': 'req-32504908-4b15-412f-b434-e01312da301f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:20.271133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.272535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-32504908-4b15-412f-b434-e01312da301f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f91a55a1d04babb9d1399378802ad8', 'request_id': 'req-32504908-4b15-412f-b434-e01312da301f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:20.272745 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:20.284288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a6537-8104-49f7-a0f4-f43ef90054a7 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.288414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-32504908-4b15-412f-b434-e01312da301f admin admin] The token cache is being invalidate because project 06f91a55a1d04babb9d1399378802ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:20.289853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-32504908-4b15-412f-b434-e01312da301f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:20.290654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-32504908-4b15-412f-b434-e01312da301f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:20.292228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1249/2489] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:19 2022] DELETE /identity/v3/projects/06f91a55a1d04babb9d1399378802ad8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:20.297184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.297584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.298004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.321861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:20.323685 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:20.338430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.339310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.339625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.339902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.341967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:20.352196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.353638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93ee95-ea76-48f9-a5c5-6f63455ed763 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.361905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1241/2490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:20.397727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1250/2491] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:20.407075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.407363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.407681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.428410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:20.430109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:20.438818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1242/2492] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:20.442775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.456054 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd904c6-9259-400b-b897-efebcb056e9e None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.461719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.462352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.462639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.462865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.463565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:20.463873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.466109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.479644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1251/2493] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:20.483915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.494647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae87fe-6a67-45d4-8ef8-48fe8b01c565 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.499662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.500318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.500604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.500881 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.501534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.503504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.598387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1243/2494] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:20 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:53:20.602967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.613531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50995f02-d4f2-4697-946c-036ba2511626 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.623659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:20.680408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.680408 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.680678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.681081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.681736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.683710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.781506 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1252/2495] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:20 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:20.786074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.797327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087489-a4fd-4ec7-bb90-561ec1b49aa9 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.802571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.803206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.803587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.803935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.804744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.806421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.816895 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1244/2496] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:53:20.822722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.838394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1981b6d-fd45-475c-b041-3d2c9889ec4c admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.844523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14548c79-e864-4ac0-bb43-b57d5b300f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.845143 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548c79-e864-4ac0-bb43-b57d5b300f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.845427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548c79-e864-4ac0-bb43-b57d5b300f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.845704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548c79-e864-4ac0-bb43-b57d5b300f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.846380 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548c79-e864-4ac0-bb43-b57d5b300f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.848064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548c79-e864-4ac0-bb43-b57d5b300f3a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:20.859778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1253/2497] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:53:20.864030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:20.874667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c58e34-86a4-49b3-bba1-e68ebdcc0478 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:20.879861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:20.880634 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:20.881196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:20.881395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] PATH_INFO: `/v3/projects/10201a0369ec40c18c5dfa7702e2f4d2/users/cb9d5d3e4e7c4b7786c0f3555a8158b6/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:20.898098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10201a0369ec40c18c5dfa7702e2f4d2, user_id=cb9d5d3e4e7c4b7786c0f3555a8158b6, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:20.901219 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.004980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1245/2498] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:20 2022] PUT /identity/v3/projects/10201a0369ec40c18c5dfa7702e2f4d2/users/cb9d5d3e4e7c4b7786c0f3555a8158b6/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:21.020316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.021040 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.021240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.072976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] MFA Rules not processed for user `cb9d5d3e4e7c4b7786c0f3555a8158b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:21.074234 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:21.138591 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1254/2499] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:21.148559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:21.277104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960187e-1141-4ebd-b7ce-6a74321f5e7e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:21.297132 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:21.297781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.298069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.298347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.299005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:21.301050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.328248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:21.395976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1246/2500] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:21 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:21.399978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:21.411806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d886f01-1ef9-4be9-bbcd-a4a88e0f6646 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:21.480740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:21.481270 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.481668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.481957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.482706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:21.484709 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.582218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1255/2501] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:21 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:53:21.588472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:21.599721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc9189-7bc1-4f0c-bf60-0e9c0f2c68a6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:21.605449 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:21.606072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.606360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.606650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.607293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:21.609083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.623865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1247/2502] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:21.625386 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:21.637201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba6c6-2577-4ad6-aba1-322b3f59dcf6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:21.649109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:21.652769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.653447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.653881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] PATH_INFO: `/v3/projects/b0c4ad1dc9b54184ae0c9c5737250fd9/users/f8b5e4981592451496dd53989198cee8/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.658521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:21.676894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c4ad1dc9b54184ae0c9c5737250fd9, user_id=f8b5e4981592451496dd53989198cee8, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:21.680117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.766398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1256/2503] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:21 2022] PUT /identity/v3/projects/b0c4ad1dc9b54184ae0c9c5737250fd9/users/f8b5e4981592451496dd53989198cee8/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:21.770245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:21.782529 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827f4cb-0882-4c99-8335-87519b7583b3 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:21.871950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4410b-2944-42c3-9e1f-964a7ab941bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:21.873046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4410b-2944-42c3-9e1f-964a7ab941bc admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.873547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4410b-2944-42c3-9e1f-964a7ab941bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.873879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4410b-2944-42c3-9e1f-964a7ab941bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.874798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4410b-2944-42c3-9e1f-964a7ab941bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:21.877003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4410b-2944-42c3-9e1f-964a7ab941bc admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.889898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1248/2504] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:53:21.894420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:21.909516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581388e4-d8ef-41dc-a948-2434988a8675 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:21.923104 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:21.924125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.924521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.924902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] PATH_INFO: `/v3/projects/b0c4ad1dc9b54184ae0c9c5737250fd9/users/f8b5e4981592451496dd53989198cee8/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:21.934511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c4ad1dc9b54184ae0c9c5737250fd9, user_id=f8b5e4981592451496dd53989198cee8, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:21.944991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:21.970036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1257/2505] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:21 2022] PUT /identity/v3/projects/b0c4ad1dc9b54184ae0c9c5737250fd9/users/f8b5e4981592451496dd53989198cee8/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:21.980525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:21.980923 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:21.981304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:22.031904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] MFA Rules not processed for user `f8b5e4981592451496dd53989198cee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:22.033484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:22.124266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1249/2506] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:22.137329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:22.137982 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:22.217921 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e8ac-0578-4e72-a676-9eb221d481dd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:22.222362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:22.223028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:22.223318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:22.223632 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:22.304374 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:22.307345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:22.323958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1258/2507] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:24.173169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:24.183792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7151-f09f-451f-a1e7-0570eeb429aa None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:24.187979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:24.188849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:24.189198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:24.189559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:24.202852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:24.205124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:24.218211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1250/2508] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:24.347146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:24.348605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:24.426592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8dc-51d9-4b93-854e-645c6a0fcc08 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:24.432980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:24.433703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:24.434175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:24.434701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:24.436799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:24.451799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:24.453763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:24.466289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1259/2509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:24.495176 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:24.497266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:24.565077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:24.584922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcba3e2-7661-4882-806b-be0486b61ca0 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:24.591982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:24.592834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:24.593306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:24.593737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] PATH_INFO: `/v3/users/043a6435674346aaa31dd842f8e12f39` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:24.595427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043a6435674346aaa31dd842f8e12f39)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:24.597558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:24.817815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043a6435674346aaa31dd842f8e12f39'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:24.818394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043a6435674346aaa31dd842f8e12f39'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:24.826747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043a6435674346aaa31dd842f8e12f39'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:24.844756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043a6435674346aaa31dd842f8e12f39'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:24.846722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ec01f10a-348b-49da-ae62-f62073e16b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043a6435674346aaa31dd842f8e12f39'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:24.940019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1251/2510] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:24 2022] DELETE /identity/v3/users/043a6435674346aaa31dd842f8e12f39 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:25.684129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:25.696030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe282-6587-4de8-a69c-27e5771cae57 service placement] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:25.709592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:25.761490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:25.762532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:25.762818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:25.763279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] PATH_INFO: `/v3/projects/717860d1fe9a4e84958b88a3ec1974e5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:25.765870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717860d1fe9a4e84958b88a3ec1974e5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:25.768158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:25.907283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717860d1fe9a4e84958b88a3ec1974e5', 'request_id': 'req-ff33a44c-353b-4c1e-bae6-2339c0757e02'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:26.011095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717860d1fe9a4e84958b88a3ec1974e5', 'request_id': 'req-ff33a44c-353b-4c1e-bae6-2339c0757e02'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:26.017280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717860d1fe9a4e84958b88a3ec1974e5', 'request_id': 'req-ff33a44c-353b-4c1e-bae6-2339c0757e02'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:26.029266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] The token cache is being invalidate because project 717860d1fe9a4e84958b88a3ec1974e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:26.029783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:26.030475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ff33a44c-353b-4c1e-bae6-2339c0757e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:26.032018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1260/2511] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:25 2022] DELETE /identity/v3/projects/717860d1fe9a4e84958b88a3ec1974e5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:26.037003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.039633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.039633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.059437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:26.062603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:26.160399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1252/2512] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:26.168803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.169469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.170261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.193828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:26.196081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:26.206203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1261/2513] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:26.210307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.221506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f5f7b-1ea5-4f83-aa1d-d3d1a34dba38 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.234646 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.235507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.235835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.236172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.236936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:26.237311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.239030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:26.254059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1253/2514] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:53:26.259613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.270955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d99969-24ae-4b86-8406-3fddb11db4de None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.278269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.279010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.279690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.280402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.283002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.285306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:26.362636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1262/2515] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:26 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:26.366547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.378761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9fdc-9974-45d0-a45a-118ee4d5182a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.437805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.438420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.438708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.438986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.439667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.441610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:26.449938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:26.548222 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1254/2516] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:26 2022] POST /identity/v3/users => generated 278 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:26.552418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.563454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343dbfb-3ce4-4c57-af4b-913587c38203 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.568193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.569191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.569484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.569856 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.571021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.572649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:26.582939 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1263/2517] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:26.587782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.597830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16b43-25aa-469d-822c-3d74293791e0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.603483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fad2bb-2c8d-4b44-bb0d-61d810da018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.604095 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fad2bb-2c8d-4b44-bb0d-61d810da018d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.604385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fad2bb-2c8d-4b44-bb0d-61d810da018d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.604660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fad2bb-2c8d-4b44-bb0d-61d810da018d admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.605311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fad2bb-2c8d-4b44-bb0d-61d810da018d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.606964 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fad2bb-2c8d-4b44-bb0d-61d810da018d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:26.618521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1255/2518] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:26.622864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.633723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b0490-5534-447e-893d-601ae0ea0588 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.638721 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.639418 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.639708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.639990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] PATH_INFO: `/v3/projects/30aa7d56ce36412eafba8b2372701e75/users/f6392a2a14784d95b3417f6d5e499047/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.656738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=30aa7d56ce36412eafba8b2372701e75, user_id=f6392a2a14784d95b3417f6d5e499047, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.660241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:26.781290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1264/2519] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:26 2022] PUT /identity/v3/projects/30aa7d56ce36412eafba8b2372701e75/users/f6392a2a14784d95b3417f6d5e499047/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:26.792520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.792819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.793209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.822788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] MFA Rules not processed for user `f6392a2a14784d95b3417f6d5e499047`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:26.824008 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:26.903847 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1256/2520] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:26.908573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:26.964161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:26.983746 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac429f-09ef-4c69-a643-0da8adeb15ef admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:26.992735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:26.993415 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:26.993762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:26.994034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:26.994673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:26.996649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.124584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1265/2521] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:26 2022] POST /identity/v3/projects => generated 355 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:27.128668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:27.139968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c14dbd-d31c-4520-ad8b-4957aa0e93ae None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:27.197108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:27.197718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.198001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.198276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.198909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:27.200940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.311949 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1257/2522] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:27 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:27.316041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:27.326624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f4e4e-6611-4ca9-9455-a05782981857 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:27.331283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:27.331958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.332296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.332580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.333232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:27.334980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.349588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1266/2523] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:27.352452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:27.362728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667581e-ec99-4668-b7f1-220fec727b65 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:27.377339 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:27.378019 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.378306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.378591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] PATH_INFO: `/v3/projects/e8fc0cff5d69406f80ed04ce17a4f9c7/users/afa96d472ce948f7bba59c9d16859331/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.395607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fc0cff5d69406f80ed04ce17a4f9c7, user_id=afa96d472ce948f7bba59c9d16859331, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:27.397490 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.482787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1258/2524] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:27 2022] PUT /identity/v3/projects/e8fc0cff5d69406f80ed04ce17a4f9c7/users/afa96d472ce948f7bba59c9d16859331/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:27.483758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:27.499717 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f41d-67c8-408b-bb35-9c2c25f74de5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:27.560552 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6f1e-af63-42b6-80a0-93511e1e5bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:27.561164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6f1e-af63-42b6-80a0-93511e1e5bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.561449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6f1e-af63-42b6-80a0-93511e1e5bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.561728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6f1e-af63-42b6-80a0-93511e1e5bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.562459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6f1e-af63-42b6-80a0-93511e1e5bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:27.564122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6f1e-af63-42b6-80a0-93511e1e5bb0 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.574910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1267/2525] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:27.579076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:27.590158 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d792a10-60da-4916-a86e-ad40bb3685d1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:27.594853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:27.595542 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.595856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.596133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] PATH_INFO: `/v3/projects/e8fc0cff5d69406f80ed04ce17a4f9c7/users/afa96d472ce948f7bba59c9d16859331/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.598099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fc0cff5d69406f80ed04ce17a4f9c7, user_id=afa96d472ce948f7bba59c9d16859331, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:27.600762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.611059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1259/2526] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:27 2022] PUT /identity/v3/projects/e8fc0cff5d69406f80ed04ce17a4f9c7/users/afa96d472ce948f7bba59c9d16859331/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:27.629003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.629220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.629496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.661752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] MFA Rules not processed for user `afa96d472ce948f7bba59c9d16859331`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:27.663034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:27.733659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1268/2527] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:27.746242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:27.748886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:27.771653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:27.807947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53045-5ec8-4535-913c-0649fc4a3dbe admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:27.812000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:27.812595 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:27.812873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:27.813145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:27.821981 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:27.823428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:27.832511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1260/2528] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:28.069192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:28.079576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0abeb-8591-4d55-a38e-3b09f9a2de12 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:28.083175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab3f69-4368-4b8c-be93-2ccb1a780016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:28.083810 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3f69-4368-4b8c-be93-2ccb1a780016 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:28.084088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3f69-4368-4b8c-be93-2ccb1a780016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:28.084492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab3f69-4368-4b8c-be93-2ccb1a780016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:28.122140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:28.148188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab3f69-4368-4b8c-be93-2ccb1a780016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:28.149792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab3f69-4368-4b8c-be93-2ccb1a780016 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:28.159128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1269/2529] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:28.748248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:28.749707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:28.831861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c53b2-6a4f-4e87-b647-3493a874abe8 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:28.845864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:28.845864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:28.845864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:28.846283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] PATH_INFO: `/v3/users/cb9d5d3e4e7c4b7786c0f3555a8158b6` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:28.847094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9d5d3e4e7c4b7786c0f3555a8158b6)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:28.849397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:29.049693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9d5d3e4e7c4b7786c0f3555a8158b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:29.049919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9d5d3e4e7c4b7786c0f3555a8158b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:29.060627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9d5d3e4e7c4b7786c0f3555a8158b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:29.073574 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9d5d3e4e7c4b7786c0f3555a8158b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:29.074325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9d5d3e4e7c4b7786c0f3555a8158b6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:29.183491 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1261/2530] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:28 2022] DELETE /identity/v3/users/cb9d5d3e4e7c4b7786c0f3555a8158b6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:29.191280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:29.191280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:29.191280 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:29.215393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:29.216654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:29.308596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1270/2531] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:29.321313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:29.324773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:29.400661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:29.414948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a692a4-e160-49b9-9087-b97c9fc35a0f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:29.418738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:29.419474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:29.419761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:29.420039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:29.433262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:29.435863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:29.450293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1262/2532] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:29.981576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:29.983071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:29.996332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cf5d4-bec5-44aa-97f6-dac9d62c2972 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:30.001119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:30.001763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:30.002181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:30.002296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] PATH_INFO: `/v3/projects/10201a0369ec40c18c5dfa7702e2f4d2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:30.003453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10201a0369ec40c18c5dfa7702e2f4d2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:30.005363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:30.144337 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10201a0369ec40c18c5dfa7702e2f4d2', 'request_id': 'req-8802bca2-b105-459d-82da-7bc42cc05459'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.228299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10201a0369ec40c18c5dfa7702e2f4d2', 'request_id': 'req-8802bca2-b105-459d-82da-7bc42cc05459'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.234358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10201a0369ec40c18c5dfa7702e2f4d2', 'request_id': 'req-8802bca2-b105-459d-82da-7bc42cc05459'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.246364 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] The token cache is being invalidate because project 10201a0369ec40c18c5dfa7702e2f4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:30.246659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.247326 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.248853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1271/2533] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:29 2022] DELETE /identity/v3/projects/10201a0369ec40c18c5dfa7702e2f4d2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:30.252859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:30.262697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402a673-7cdc-40ee-8483-7b0921767db9 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:30.319210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:30.319875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:30.320210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:30.320491 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] PATH_INFO: `/v3/users/f8b5e4981592451496dd53989198cee8` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:30.321613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b5e4981592451496dd53989198cee8)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:30.323558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:30.538105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b5e4981592451496dd53989198cee8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.539407 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b5e4981592451496dd53989198cee8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.548655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b5e4981592451496dd53989198cee8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.562398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b5e4981592451496dd53989198cee8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.563162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b5e4981592451496dd53989198cee8'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:30.654619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1263/2534] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:30 2022] DELETE /identity/v3/users/f8b5e4981592451496dd53989198cee8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:31.073750 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:31.075273 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:31.122604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802bca2-b105-459d-82da-7bc42cc05459 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:31.210509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:31.211362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.211678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.212018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] PATH_INFO: `/v3/projects/b0c4ad1dc9b54184ae0c9c5737250fd9` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.213187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c4ad1dc9b54184ae0c9c5737250fd9)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:31.215429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:31.217343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:31.318580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:31.320346 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:31.345262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c4ad1dc9b54184ae0c9c5737250fd9', 'request_id': 'req-1af5fd45-5ced-4ffb-b764-7fc44196df76'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:31.395779 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:31.402591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7de17-bbdb-47f5-8348-aee659ddb4c2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:31.437986 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c4ad1dc9b54184ae0c9c5737250fd9', 'request_id': 'req-1af5fd45-5ced-4ffb-b764-7fc44196df76'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:31.448293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c4ad1dc9b54184ae0c9c5737250fd9', 'request_id': 'req-1af5fd45-5ced-4ffb-b764-7fc44196df76'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:31.462757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] The token cache is being invalidate because project b0c4ad1dc9b54184ae0c9c5737250fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:31.463056 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:31.464174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1af5fd45-5ced-4ffb-b764-7fc44196df76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:31.466813 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1272/2535] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:31 2022] DELETE /identity/v3/projects/b0c4ad1dc9b54184ae0c9c5737250fd9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:31.471477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.471801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.472084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.481375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:31.481992 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.482281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.482561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.484344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:31.493189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:31.494382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:31.496891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:31.498810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6d025-dd3e-4299-b9a3-92b1a70b48b5 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:31.511091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1264/2536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:31.559413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1273/2537] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:31.568136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.568487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.568774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.590696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:31.591921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:31.599803 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1265/2538] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:31.604342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:31.614072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000da68-85da-41a6-9cd9-3388696b49b1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:31.619455 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:31.624072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.624072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.624072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.624072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:31.624072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:31.624072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:31.636204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1274/2539] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:31.640296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:31.650115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0980-6eae-4a8b-9de6-d6ce61524729 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:31.667255 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:31.667920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.668205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.668505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.669150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:31.671319 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:31.782316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1266/2540] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:31 2022] POST /identity/v3/projects => generated 401 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:31.783640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:31.803995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d7df4-fd99-4800-baf5-db1414a47865 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:31.883516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:31.883516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:31.883516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:31.883516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:31.883957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:31.884470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:31.987960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1275/2541] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:31 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:31.992787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.003136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052efd83-f810-4e0c-91d8-1c88fb3f7594 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.008354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.008990 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.009272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.009548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.010200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.011836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.022015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1267/2542] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:32.027773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.040246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1185-c07f-49d8-aa0e-70c209f33736 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.046101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dc85f-70cf-4bbb-b1a8-8cc7067b18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.046948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc85f-70cf-4bbb-b1a8-8cc7067b18fb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.047279 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc85f-70cf-4bbb-b1a8-8cc7067b18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.047783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc85f-70cf-4bbb-b1a8-8cc7067b18fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.048449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dc85f-70cf-4bbb-b1a8-8cc7067b18fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.050190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dc85f-70cf-4bbb-b1a8-8cc7067b18fb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.051714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:32.062128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1276/2543] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:32.066601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.077164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f753-2bed-4259-b9f2-99439c8c08a7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.081705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.082424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.082708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.082985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] PATH_INFO: `/v3/projects/b93370e699874b41a241ff2941f41d78/users/b6a2c6c1b7b64cb6a80f92ffb126c2b7/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.097719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93370e699874b41a241ff2941f41d78, user_id=b6a2c6c1b7b64cb6a80f92ffb126c2b7, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.100415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.194163 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1268/2544] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:32 2022] PUT /identity/v3/projects/b93370e699874b41a241ff2941f41d78/users/b6a2c6c1b7b64cb6a80f92ffb126c2b7/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:32.205753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.206059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.206334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.235723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] MFA Rules not processed for user `b6a2c6c1b7b64cb6a80f92ffb126c2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:32.237082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:32.306329 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1277/2545] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:32.310980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.374399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722db65-cf62-43c8-a230-d9997b108888 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.379185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.379831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.380114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.380387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.381017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.383955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.501199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1269/2546] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:32 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:32.505327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.517001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efaa5e-ae2c-442d-9506-e4319248ac69 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.574026 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.574627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.574908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.575179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.575838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.577836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.682805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1278/2547] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:32 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:32.686852 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.697742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91428a-23b2-40db-a534-687fbf57545a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.702400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.702999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.703286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.703596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.704244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.705821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.709326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:32.717511 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1270/2548] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:32.721659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.731692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1499a-36e5-45d2-9e1e-264d86fea269 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.736221 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.736887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.738024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.738024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] PATH_INFO: `/v3/projects/860856b733f74321b43be6b9b716aca6/users/46aaab8f6718483eafb3e72734d53b7b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.752692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=860856b733f74321b43be6b9b716aca6, user_id=46aaab8f6718483eafb3e72734d53b7b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.755397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.820564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1279/2549] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:32 2022] PUT /identity/v3/projects/860856b733f74321b43be6b9b716aca6/users/46aaab8f6718483eafb3e72734d53b7b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:32.824565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.835260 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb395e20-4764-4a80-8684-47618b4c83d4 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.893988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a4504-a7bd-4972-aa38-f1566866ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.894601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a4504-a7bd-4972-aa38-f1566866ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.894889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a4504-a7bd-4972-aa38-f1566866ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.895164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a4504-a7bd-4972-aa38-f1566866ce6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.895840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a4504-a7bd-4972-aa38-f1566866ce6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.897419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a4504-a7bd-4972-aa38-f1566866ce6f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.907426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1271/2550] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:32.911678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:32.922570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c801872-89b1-4f4e-bfe5-3c9d97d18d0d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:32.927348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:32.928392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.928673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.928948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] PATH_INFO: `/v3/projects/860856b733f74321b43be6b9b716aca6/users/46aaab8f6718483eafb3e72734d53b7b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.931496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] RBAC: Authorizing `identity:create_grant(project_id=860856b733f74321b43be6b9b716aca6, user_id=46aaab8f6718483eafb3e72734d53b7b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:32.934169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:32.947466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1280/2551] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:32 2022] PUT /identity/v3/projects/860856b733f74321b43be6b9b716aca6/users/46aaab8f6718483eafb3e72734d53b7b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:32.957105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:32.959344 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:32.959792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:32.993237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] MFA Rules not processed for user `46aaab8f6718483eafb3e72734d53b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:32.996592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:33.110354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1272/2552] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:33.121404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:33.123082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:33.181621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:33.196961 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a67e36-f5ed-48f4-89fe-ad56868b719a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:33.200622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:33.201319 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:33.201605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:33.201884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:33.211890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:33.213422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:33.223711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1281/2553] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:33.487361 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:33.497032 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ad88-de46-4c64-9cb1-b5b1d5048f92 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:33.501700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:33.502314 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:33.502596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:33.502873 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:33.560831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:33.562304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:33.571317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1273/2554] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:34.442503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:34.443953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:34.502582 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc59f9-e352-4aa9-8a3d-8ec1e609df30 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:34.506512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:34.507136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:34.507450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:34.508327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:34.510416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:34.577668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:34.579170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef83bce-fd78-4817-aaed-ed90e9886121 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:34.590090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1282/2555] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:38.945608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:38.965626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:39.009994 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560c1d3-a904-4c26-9b23-dcd83a5c60a2 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:39.015505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:39.016145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:39.016428 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:39.016705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] PATH_INFO: `/v3/users/b6a2c6c1b7b64cb6a80f92ffb126c2b7` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:39.017874 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a2c6c1b7b64cb6a80f92ffb126c2b7)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:39.019828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:39.218957 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a2c6c1b7b64cb6a80f92ffb126c2b7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:39.219575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a2c6c1b7b64cb6a80f92ffb126c2b7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:39.226548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a2c6c1b7b64cb6a80f92ffb126c2b7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:39.239270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a2c6c1b7b64cb6a80f92ffb126c2b7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:39.239955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a2c6c1b7b64cb6a80f92ffb126c2b7'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:39.306398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1274/2556] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:38 2022] DELETE /identity/v3/users/b6a2c6c1b7b64cb6a80f92ffb126c2b7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:39.310863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:39.311324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:39.311499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:39.330771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:39.332045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:39.391622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1283/2557] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:39.401300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:39.402995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:39.462159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24e308-48a7-4fc3-ace9-7a23080e5f64 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:39.466056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:39.466662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:39.466943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:39.467212 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:39.476760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:39.478626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:39.488767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1275/2558] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:39.950216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:39.951722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:39.966318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a4722-e833-42d7-905b-a73ad032a8bf None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:39.972004 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:39.972916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:39.973198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:39.974695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] PATH_INFO: `/v3/projects/b93370e699874b41a241ff2941f41d78` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:39.974814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93370e699874b41a241ff2941f41d78)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:39.976776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:40.093180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:40.110751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93370e699874b41a241ff2941f41d78', 'request_id': 'req-58cc0640-76e4-49e9-b1c5-d0e4185e7907'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.219775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93370e699874b41a241ff2941f41d78', 'request_id': 'req-58cc0640-76e4-49e9-b1c5-d0e4185e7907'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.229114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93370e699874b41a241ff2941f41d78', 'request_id': 'req-58cc0640-76e4-49e9-b1c5-d0e4185e7907'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.241691 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] The token cache is being invalidate because project b93370e699874b41a241ff2941f41d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:40.241915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.242608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.245042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1284/2559] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:39 2022] DELETE /identity/v3/projects/b93370e699874b41a241ff2941f41d78 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:40.249600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:40.259506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fd9b-f543-4043-8a89-15d362047a36 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:40.299545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:40.317851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:40.318473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:40.318754 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:40.319028 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] PATH_INFO: `/v3/users/46aaab8f6718483eafb3e72734d53b7b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:40.320167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46aaab8f6718483eafb3e72734d53b7b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:40.322187 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:40.531871 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46aaab8f6718483eafb3e72734d53b7b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.532524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46aaab8f6718483eafb3e72734d53b7b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.541486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46aaab8f6718483eafb3e72734d53b7b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.554085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46aaab8f6718483eafb3e72734d53b7b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.554792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1a2b610e-6074-4227-8ed7-5b539f8f439b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46aaab8f6718483eafb3e72734d53b7b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:40.656789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1276/2560] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:40 2022] DELETE /identity/v3/users/46aaab8f6718483eafb3e72734d53b7b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:41.075860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.077285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:41.091332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc0640-76e4-49e9-b1c5-d0e4185e7907 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.156468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.157175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.157456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.157730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] PATH_INFO: `/v3/projects/860856b733f74321b43be6b9b716aca6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.159010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] RBAC: Authorizing `identity:delete_project(project_id=860856b733f74321b43be6b9b716aca6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.161016 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.257897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860856b733f74321b43be6b9b716aca6', 'request_id': 'req-ca084a5c-681a-4b31-94b7-905a0c4935be'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:41.313666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860856b733f74321b43be6b9b716aca6', 'request_id': 'req-ca084a5c-681a-4b31-94b7-905a0c4935be'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:41.319698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860856b733f74321b43be6b9b716aca6', 'request_id': 'req-ca084a5c-681a-4b31-94b7-905a0c4935be'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:41.331659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] The token cache is being invalidate because project 860856b733f74321b43be6b9b716aca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:41.331952 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:41.332579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ca084a5c-681a-4b31-94b7-905a0c4935be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:41.334050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1285/2561] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:41 2022] DELETE /identity/v3/projects/860856b733f74321b43be6b9b716aca6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:41.339230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.339721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.339835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.359908 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:41.361115 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:41.421309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1277/2562] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:41.429173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.429464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.429742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.451777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:41.452993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:41.461106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1286/2563] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:41.465575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.474900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950279d-93ba-4fb5-9b1f-6377bd810707 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.480033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.480736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.481057 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.481370 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.482170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:41.482521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.484305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.496592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1278/2564] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:41.500844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.510035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc045-5a86-4371-baea-03e6ab130c34 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.514598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.515187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.515517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.515794 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.516411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.518295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.595833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1287/2565] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:41 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:41.599671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.611051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc9a2e-df64-44a8-bde1-4a8de914bade admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.657269 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:41.669789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.674764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.674764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.674764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.674764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.674764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.774717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1279/2566] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:41 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:41.778548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.789307 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd74c-0076-47d2-a88c-8e58e9f4a4c1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.794969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.795611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.795898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.796178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.796826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.798627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.810768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1288/2567] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:41.814794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.824757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80d1c-6536-40b9-a587-972c90b7f820 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.829413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb39c-a010-4e17-81fe-44469c234378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.829961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb39c-a010-4e17-81fe-44469c234378 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.830239 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb39c-a010-4e17-81fe-44469c234378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.830517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb39c-a010-4e17-81fe-44469c234378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.831154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb39c-a010-4e17-81fe-44469c234378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.832765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb39c-a010-4e17-81fe-44469c234378 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.844434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1280/2568] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:41.848729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:41.857499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:41.862896 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57927cd9-454a-4719-84e7-8c61427f2f6e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:41.869047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:41.869719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.870005 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.870394 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] PATH_INFO: `/v3/projects/57080332ce1f413cb9f86763426047d5/users/47682fd88565408ab5008f25a5afe8ce/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:41.886199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57080332ce1f413cb9f86763426047d5, user_id=47682fd88565408ab5008f25a5afe8ce, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:41.888980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:41.974045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1289/2569] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:41 2022] PUT /identity/v3/projects/57080332ce1f413cb9f86763426047d5/users/47682fd88565408ab5008f25a5afe8ce/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:41.994474 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:41.994764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:41.995066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.023022 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] MFA Rules not processed for user `47682fd88565408ab5008f25a5afe8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:42.024318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:42.091531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1281/2570] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:42.096070 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.157204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de948077-fd6c-47bf-9a8c-076de4469512 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.161707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.162299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.162577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.162857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.163545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.166091 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:42.251915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1290/2571] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:42 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:53:42.256094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.267205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b11f9-0dee-4032-8fc5-d5f1bffdba68 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.322802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.323436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.323725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.324003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.324647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.326548 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:42.406364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1282/2572] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:42 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:42.410407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.421278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa346-992c-49eb-8eda-d3c246be9798 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.426114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.426711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.426994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.427274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.427983 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.429575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:42.440359 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1291/2573] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:42.444461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.454902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339a52-fa97-4280-90e1-fef5f15c78bd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.459627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.460398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.460691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.460972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] PATH_INFO: `/v3/projects/31d0fdd2eb0b4deb9454d39a153ac2ee/users/d1c1f4b25cb842eaaff103f9ac3e4960/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.477413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d0fdd2eb0b4deb9454d39a153ac2ee, user_id=d1c1f4b25cb842eaaff103f9ac3e4960, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.480107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:42.577101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1283/2574] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:42 2022] PUT /identity/v3/projects/31d0fdd2eb0b4deb9454d39a153ac2ee/users/d1c1f4b25cb842eaaff103f9ac3e4960/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:42.581044 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.592352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdb308-55d6-4e53-b379-de1bada28742 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.655173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e84cc4-750a-4198-b32b-67309025e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.655729 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84cc4-750a-4198-b32b-67309025e42e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.656013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84cc4-750a-4198-b32b-67309025e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.656289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e84cc4-750a-4198-b32b-67309025e42e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.656934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e84cc4-750a-4198-b32b-67309025e42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.658532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e84cc4-750a-4198-b32b-67309025e42e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:42.669216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1292/2575] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:42.673305 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.683524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1506bff-84bf-4b94-9d48-8ca959c4b6fd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.688023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.691808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.691808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.691808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] PATH_INFO: `/v3/projects/31d0fdd2eb0b4deb9454d39a153ac2ee/users/d1c1f4b25cb842eaaff103f9ac3e4960/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.691808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d0fdd2eb0b4deb9454d39a153ac2ee, user_id=d1c1f4b25cb842eaaff103f9ac3e4960, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.693666 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:42.703783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1284/2576] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:42 2022] PUT /identity/v3/projects/31d0fdd2eb0b4deb9454d39a153ac2ee/users/d1c1f4b25cb842eaaff103f9ac3e4960/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:42.715724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec789-c523-4e37-a2fa-2f1f80e12262 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.720560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec789-c523-4e37-a2fa-2f1f80e12262 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.720560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec789-c523-4e37-a2fa-2f1f80e12262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.759996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b9fec789-c523-4e37-a2fa-2f1f80e12262 None None] MFA Rules not processed for user `d1c1f4b25cb842eaaff103f9ac3e4960`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:42.761778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b9fec789-c523-4e37-a2fa-2f1f80e12262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:42.819274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:42.852045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1293/2577] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:42.863771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:42.865660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:42.877468 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:42.903396 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.903684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.903959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.924820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:42.926017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:42.968932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2409558-d006-48d8-a103-7748573c0ed8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:42.972617 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:42.977814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:42.977814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:42.977814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:42.987568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:42.989280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:43.003553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1285/2578] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:43.005347 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1294/2579] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:43.159498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:43.163909 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:43.272280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f1b8f-0f90-4d80-a938-823197818db2 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:43.278450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb53ecf-81a6-4faf-ac0f-1254cae5e232 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:43.279076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb53ecf-81a6-4faf-ac0f-1254cae5e232 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:43.279437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb53ecf-81a6-4faf-ac0f-1254cae5e232 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:43.279718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb53ecf-81a6-4faf-ac0f-1254cae5e232 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:43.299476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb53ecf-81a6-4faf-ac0f-1254cae5e232 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:43.299476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb53ecf-81a6-4faf-ac0f-1254cae5e232 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:43.308984 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1286/2580] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:43.657293 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:43.746147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5dcea-7471-47f6-bfc0-18cabd3e214c None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:43.750824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:43.751512 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:43.751795 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:43.752076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] PATH_INFO: `/v3/users/47682fd88565408ab5008f25a5afe8ce` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:43.753222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=47682fd88565408ab5008f25a5afe8ce)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:43.755166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:43.959028 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47682fd88565408ab5008f25a5afe8ce'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:44.050622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47682fd88565408ab5008f25a5afe8ce'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:44.066193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47682fd88565408ab5008f25a5afe8ce'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:44.079085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47682fd88565408ab5008f25a5afe8ce'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:44.079848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47682fd88565408ab5008f25a5afe8ce'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:44.082194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:44.089788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1295/2581] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:43 2022] DELETE /identity/v3/users/47682fd88565408ab5008f25a5afe8ce => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:44.094573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:44.095085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:44.095312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:44.116635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:44.118825 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:44.189114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1287/2582] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:44.198614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:44.203748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:44.307036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f04d0-4505-4946-b66d-18cd904e58ad admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:44.311284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:44.312318 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:44.312613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:44.312891 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:44.325784 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:44.327251 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:44.343635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1296/2583] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:44.963050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:44.964856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:44.980000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a08b89-a20f-4bcb-99ce-47b285629945 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:44.997700 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:44.998620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:44.999777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:44.999777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] PATH_INFO: `/v3/projects/57080332ce1f413cb9f86763426047d5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:45.002047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57080332ce1f413cb9f86763426047d5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:45.005157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:45.121033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:45.130434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57080332ce1f413cb9f86763426047d5', 'request_id': 'req-8f89d25b-79a0-4216-80be-9391aae8365b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.139583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57080332ce1f413cb9f86763426047d5', 'request_id': 'req-8f89d25b-79a0-4216-80be-9391aae8365b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.146408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57080332ce1f413cb9f86763426047d5', 'request_id': 'req-8f89d25b-79a0-4216-80be-9391aae8365b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.250861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] The token cache is being invalidate because project 57080332ce1f413cb9f86763426047d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:45.251516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.252486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.254402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1288/2584] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:44 2022] DELETE /identity/v3/projects/57080332ce1f413cb9f86763426047d5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:45.258315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:45.275198 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ce74-aa43-47da-b328-8f2bfec08763 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:45.370664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:45.371316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:45.371942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:45.371942 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] PATH_INFO: `/v3/users/d1c1f4b25cb842eaaff103f9ac3e4960` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:45.373197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c1f4b25cb842eaaff103f9ac3e4960)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:45.375362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:45.590202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c1f4b25cb842eaaff103f9ac3e4960'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.653884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c1f4b25cb842eaaff103f9ac3e4960'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.673437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c1f4b25cb842eaaff103f9ac3e4960'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.687474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c1f4b25cb842eaaff103f9ac3e4960'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.689041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d64c4a61-e46b-47da-acdc-3276640f5ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c1f4b25cb842eaaff103f9ac3e4960'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:45.696218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1297/2585] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:45 2022] DELETE /identity/v3/users/d1c1f4b25cb842eaaff103f9ac3e4960 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:46.284324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:46.284324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:46.301817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d25b-79a0-4216-80be-9391aae8365b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:46.379687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:46.380365 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:46.380669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:46.380982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] PATH_INFO: `/v3/projects/31d0fdd2eb0b4deb9454d39a153ac2ee` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:46.382107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d0fdd2eb0b4deb9454d39a153ac2ee)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:46.384804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:46.723983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d0fdd2eb0b4deb9454d39a153ac2ee', 'request_id': 'req-94ab2b08-ac09-4ce3-ab72-112247c59de6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:46.731031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d0fdd2eb0b4deb9454d39a153ac2ee', 'request_id': 'req-94ab2b08-ac09-4ce3-ab72-112247c59de6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:46.748304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d0fdd2eb0b4deb9454d39a153ac2ee', 'request_id': 'req-94ab2b08-ac09-4ce3-ab72-112247c59de6'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:46.834701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] The token cache is being invalidate because project 31d0fdd2eb0b4deb9454d39a153ac2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:46.842352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:46.842352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:46.842352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1289/2586] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:46 2022] DELETE /identity/v3/projects/31d0fdd2eb0b4deb9454d39a153ac2ee => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:46.844207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905adb-3b82-4d9f-91bb-023800928e11 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:46.844663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905adb-3b82-4d9f-91bb-023800928e11 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:46.844792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905adb-3b82-4d9f-91bb-023800928e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:46.877238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ec905adb-3b82-4d9f-91bb-023800928e11 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:46.889902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ec905adb-3b82-4d9f-91bb-023800928e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:46.903600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:46.905090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:46.930561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:46.979309 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:47.007227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab2b08-ac09-4ce3-ab72-112247c59de6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.020535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.020535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.020796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.021156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] PATH_INFO: `/v3/users/f6392a2a14784d95b3417f6d5e499047` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.023861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6392a2a14784d95b3417f6d5e499047)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.026014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.033678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1298/2587] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:47.041567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.042580 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.051542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.070861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:47.072821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:47.081890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1299/2588] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:47.085857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.095902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77330fd-63f9-4b80-8e1a-7779482d3f60 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.101156 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.101929 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.102217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.102544 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.103594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:47.103914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.105529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.122666 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1300/2589] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:53:47.127260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.138437 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283771a6-57a3-44f3-a3d0-1a38b75eacb7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.143765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.144508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.144873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.153459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.153459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.153459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.242610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6392a2a14784d95b3417f6d5e499047'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:47.244064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6392a2a14784d95b3417f6d5e499047'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:47.254802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6392a2a14784d95b3417f6d5e499047'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:47.266144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1301/2590] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:47 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:47.267072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.268893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:47.277662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6392a2a14784d95b3417f6d5e499047'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:47.278506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-468dce33-2589-4897-b9d2-66338e4291db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6392a2a14784d95b3417f6d5e499047'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:47.351750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1290/2591] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:46 2022] DELETE /identity/v3/users/f6392a2a14784d95b3417f6d5e499047 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:47.352435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914de594-d806-42f7-84c9-b52cf96f5746 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.356893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.357535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.358059 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.382206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:47.383661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:47.434008 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.435163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.435697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.436196 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.437055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.440833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.461086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1291/2592] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:47.471773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.473422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:47.516330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1302/2593] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:47 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:47.520684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.533136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289c22d-0c4e-41a9-8f28-25b132b8e71e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.541812 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.542464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.542894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.543183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.543878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.545699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.553228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041575f5-efc8-4fe9-89ff-2ead861f23a8 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.556880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1303/2594] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:53:47.558399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.559155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.559534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.559756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.560748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.570907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.573164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.577893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bea79-e5e0-4efb-ac06-73689615d4fb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.584481 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add565f-6fcd-4ee8-9aca-b051c5ace6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.585320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add565f-6fcd-4ee8-9aca-b051c5ace6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.585583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add565f-6fcd-4ee8-9aca-b051c5ace6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.585824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1292/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:47.591690 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add565f-6fcd-4ee8-9aca-b051c5ace6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.592468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add565f-6fcd-4ee8-9aca-b051c5ace6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.594344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add565f-6fcd-4ee8-9aca-b051c5ace6e1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.595913 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:47.612391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1304/2596] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:47.617894 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.628329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ebb13-37b1-4aa6-b20e-e4a39d631d25 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:47.636943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:47.637932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.638189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.638576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] PATH_INFO: `/v3/projects/7bdf321d3c654f60932028ac8f5fb375/users/52abb33f9cdd4c8aba6d48591d34a9f4/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.656331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:47.660237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdf321d3c654f60932028ac8f5fb375, user_id=52abb33f9cdd4c8aba6d48591d34a9f4, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:47.665373 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:47.753203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1293/2597] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:47 2022] PUT /identity/v3/projects/7bdf321d3c654f60932028ac8f5fb375/users/52abb33f9cdd4c8aba6d48591d34a9f4/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:47.765083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:47.765532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:47.765989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:47.832360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] MFA Rules not processed for user `52abb33f9cdd4c8aba6d48591d34a9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:47.834258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:47.933083 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1305/2598] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:47.944658 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:47.947299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:48.028334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bd15e-252f-4e2a-b87c-d9cc20613e8d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:48.032112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:48.032866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:48.034956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:48.034956 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:48.043917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:48.045376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:48.059190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1294/2599] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:48.083616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:48.126440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:48.128087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:48.195607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905df11c-f82f-4c8d-bbe7-486bfc69dc46 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:48.201655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:48.202255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:48.203094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:48.203094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] PATH_INFO: `/v3/users/52abb33f9cdd4c8aba6d48591d34a9f4` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:48.204610 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=52abb33f9cdd4c8aba6d48591d34a9f4)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:48.207515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:48.254133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36819ae5-a7a2-49a6-ab26-714d95a0bd9e service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:48.267728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:48.268679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:48.269870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:48.269870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] PATH_INFO: `/v3/projects/30aa7d56ce36412eafba8b2372701e75` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:48.270826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30aa7d56ce36412eafba8b2372701e75)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:48.272805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:48.458326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30aa7d56ce36412eafba8b2372701e75', 'request_id': 'req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.463118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52abb33f9cdd4c8aba6d48591d34a9f4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.468775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30aa7d56ce36412eafba8b2372701e75', 'request_id': 'req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.475954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30aa7d56ce36412eafba8b2372701e75', 'request_id': 'req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.528838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52abb33f9cdd4c8aba6d48591d34a9f4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.546611 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52abb33f9cdd4c8aba6d48591d34a9f4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.555420 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52abb33f9cdd4c8aba6d48591d34a9f4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.556978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-bdbbf9df-72d1-4077-9c94-0293c02451ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52abb33f9cdd4c8aba6d48591d34a9f4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.563614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1306/2600] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:48 2022] DELETE /identity/v3/users/52abb33f9cdd4c8aba6d48591d34a9f4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:48.568042 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:48.568532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:48.568902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:48.577737 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:48.597540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:48.599067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:48.599942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] The token cache is being invalidate because project 30aa7d56ce36412eafba8b2372701e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:48.600463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.601156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.604223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1295/2601] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:48 2022] DELETE /identity/v3/projects/30aa7d56ce36412eafba8b2372701e75 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:48.610003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:48.612200 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:48.650091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:48.690062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1307/2602] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:48.702483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:48.704716 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e6860-4e67-4644-9dcf-1a3af0cb26f2 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:48.705281 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:48.711154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:48.712067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:48.712372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:48.712629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] PATH_INFO: `/v3/users/afa96d472ce948f7bba59c9d16859331` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:48.714329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa96d472ce948f7bba59c9d16859331)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:48.718161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:48.786850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a495bf-1908-42ee-a4a8-9dfc4c668e36 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:48.791334 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:48.792356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:48.792660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:48.792941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:48.806728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:48.810284 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:48.825840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1308/2603] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:48.937569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa96d472ce948f7bba59c9d16859331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.940099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa96d472ce948f7bba59c9d16859331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.952151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa96d472ce948f7bba59c9d16859331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.969318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa96d472ce948f7bba59c9d16859331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:48.970329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa96d472ce948f7bba59c9d16859331'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.076322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1296/2604] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:48 2022] DELETE /identity/v3/users/afa96d472ce948f7bba59c9d16859331 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:49.304686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:49.309571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:49.332469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1ef96-0527-47ba-a0d3-438078820d1a service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:49.457119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:49.457933 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:49.458314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:49.458742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] PATH_INFO: `/v3/projects/7bdf321d3c654f60932028ac8f5fb375` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:49.461263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bdf321d3c654f60932028ac8f5fb375)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:49.469316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:49.669563 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdf321d3c654f60932028ac8f5fb375', 'request_id': 'req-df9e4464-ae10-4172-b857-773a941f3799'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.679429 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:49.682456 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:49.687944 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:49.701586 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b176b8f-6a8a-4104-942a-6ec7422c34fb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:49.776661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:49.777329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:49.777613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:49.777885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] PATH_INFO: `/v3/projects/e8fc0cff5d69406f80ed04ce17a4f9c7` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:49.779224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fc0cff5d69406f80ed04ce17a4f9c7)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:49.781306 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:49.799417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdf321d3c654f60932028ac8f5fb375', 'request_id': 'req-df9e4464-ae10-4172-b857-773a941f3799'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.807231 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdf321d3c654f60932028ac8f5fb375', 'request_id': 'req-df9e4464-ae10-4172-b857-773a941f3799'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.831328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] The token cache is being invalidate because project 7bdf321d3c654f60932028ac8f5fb375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:49.831328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.831328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-df9e4464-ae10-4172-b857-773a941f3799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.831328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1309/2605] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:49 2022] DELETE /identity/v3/projects/7bdf321d3c654f60932028ac8f5fb375 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:49.831328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eade56-f12f-4189-a570-978c38361516 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:49.831895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eade56-f12f-4189-a570-978c38361516 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:49.831895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eade56-f12f-4189-a570-978c38361516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:49.854862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-36eade56-f12f-4189-a570-978c38361516 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:49.856136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-36eade56-f12f-4189-a570-978c38361516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:49.867410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1310/2606] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:49.921290 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:49.928074 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fc0cff5d69406f80ed04ce17a4f9c7', 'request_id': 'req-83c96f27-32f3-4db0-9ea1-812034286b31'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.933239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:49.933239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:49.933239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:49.936638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fc0cff5d69406f80ed04ce17a4f9c7', 'request_id': 'req-83c96f27-32f3-4db0-9ea1-812034286b31'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.944367 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fc0cff5d69406f80ed04ce17a4f9c7', 'request_id': 'req-83c96f27-32f3-4db0-9ea1-812034286b31'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:49.953153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:49.954463 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:50.010848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] The token cache is being invalidate because project e8fc0cff5d69406f80ed04ce17a4f9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:50.011304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:50.012482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-83c96f27-32f3-4db0-9ea1-812034286b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:50.017499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1297/2607] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:49 2022] DELETE /identity/v3/projects/e8fc0cff5d69406f80ed04ce17a4f9c7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:50.018997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e65c-8164-4554-acb1-1150ed3b2380 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.019284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e65c-8164-4554-acb1-1150ed3b2380 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.019613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e65c-8164-4554-acb1-1150ed3b2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.020482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1311/2608] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:50.034845 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.042559 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-fa09e65c-8164-4554-acb1-1150ed3b2380 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:50.043811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-fa09e65c-8164-4554-acb1-1150ed3b2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:50.048776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5c58b-76cd-4b03-9d38-1d8e79d39f6a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.052276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1298/2609] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:50.053623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.054241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.054528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.054806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.056212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:50.056533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.058351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.061173 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.061459 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.061759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.074769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1312/2610] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:50.075909 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.082607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:50.083890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:50.086233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51341-981b-4e88-9f09-676939157f1e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.091669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.092264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.092543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.092813 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.093156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1299/2611] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:50.093443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.095387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.097543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.107728 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5151db-78cf-4817-9975-9615f6cfc600 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.112921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.113518 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.113800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.114076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.114723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:50.115055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.116678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.128806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1300/2612] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:53:50.133304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.143201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b65e0e-a480-447b-98e8-248d24b69f68 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.148328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.148904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.149183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.150013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.150741 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.152902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.580263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1313/2613] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:50 2022] POST /identity/v3/projects => generated 375 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:50.581173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.598572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1301/2614] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:50 2022] POST /identity/v3/projects => generated 365 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:53:50.602961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.664372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691675e-4a36-47e5-80c1-95d952b95f3a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.686552 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339870f-78c8-4ce1-aa6f-476de38d1299 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.693514 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.694331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.695001 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.695396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.696364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.699774 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.729442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:50.745861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.746577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.746932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.747538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.748607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.750976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.789504 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1302/2615] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:50 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:50.795184 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.807110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176daa9f-0017-4bf4-9328-9ed4f3ae6733 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.812190 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.812857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.813145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.813423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.814106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.823557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1314/2616] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:50 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:50.823799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.827669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.844941 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1303/2617] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:50.845197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c24110-f484-4da9-a604-56bbd78ae7e8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.846979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.851403 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.852241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.852581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.852848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.853951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.855859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.858785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cd7e1-0ab4-43af-8620-47a2dd4d331f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.864390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.865112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.865473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.865821 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.866587 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.867539 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1315/2618] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:50.869069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.871723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.882251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1304/2619] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:50.883584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e682-6527-4738-bf5e-efe71d9a8ffc admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.886836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.890240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.890956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.891312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.891698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.892549 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.894160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.901991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15588c24-e7b1-4360-b68e-9594f4e49fd1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.907246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f7fcc-8643-4d24-8f3c-d34169012d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.908153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f7fcc-8643-4d24-8f3c-d34169012d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.908657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f7fcc-8643-4d24-8f3c-d34169012d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.909183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f7fcc-8643-4d24-8f3c-d34169012d54 admin admin] PATH_INFO: `/v3/projects/c62c1076a9234e38b3de1a33c6463ed9/users/9c535aac5aeb49d2877b1caf6f844525/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.912779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1316/2620] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:53:50.913657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:50.929530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368670a1-c8c3-4f94-b815-15508076e554 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:50.936783 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f7fcc-8643-4d24-8f3c-d34169012d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62c1076a9234e38b3de1a33c6463ed9, user_id=9c535aac5aeb49d2877b1caf6f844525, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.937166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edc0db-9b22-4a71-8ad4-2f9f56e63986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:50.937912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edc0db-9b22-4a71-8ad4-2f9f56e63986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:50.938277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edc0db-9b22-4a71-8ad4-2f9f56e63986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:50.938589 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edc0db-9b22-4a71-8ad4-2f9f56e63986 admin admin] PATH_INFO: `/v3/projects/f1081acbbbb843a19ed01e3a999d664d/users/5ffad73a52bb4971beb81ca78ed9efd2/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:50.939549 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f7fcc-8643-4d24-8f3c-d34169012d54 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:50.957651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edc0db-9b22-4a71-8ad4-2f9f56e63986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1081acbbbb843a19ed01e3a999d664d, user_id=5ffad73a52bb4971beb81ca78ed9efd2, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:50.960622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edc0db-9b22-4a71-8ad4-2f9f56e63986 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.013551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1305/2621] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:50 2022] PUT /identity/v3/projects/c62c1076a9234e38b3de1a33c6463ed9/users/9c535aac5aeb49d2877b1caf6f844525/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:51.025326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.025576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.026010 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.053114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1317/2622] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:50 2022] PUT /identity/v3/projects/f1081acbbbb843a19ed01e3a999d664d/users/5ffad73a52bb4971beb81ca78ed9efd2/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:51.059598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] MFA Rules not processed for user `9c535aac5aeb49d2877b1caf6f844525`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:51.060897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:51.064670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.064974 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.065253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.082182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:51.099472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] MFA Rules not processed for user `5ffad73a52bb4971beb81ca78ed9efd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:51.100733 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:51.140983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1306/2623] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:51.146480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.185797 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1318/2624] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:51.190312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.256065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5779719-af7f-4b43-bc28-b2dc8e874677 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.264426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.264426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.264426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.264426 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.265107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.266122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.302097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a1dd-c704-46ed-871e-d3be0351f4db None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.310077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.310708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.310993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.311268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.311958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.314226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.377075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1307/2625] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:51.378234 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.432074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1319/2626] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:51.433006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.437874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:51.457564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64367cc-c00a-4a0b-bac7-943890b2033a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.512536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315157c9-5f5a-4d65-bc76-db1395a90a58 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.517696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.518336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.519039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.519597 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.520745 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.522443 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:51.524378 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.535009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.536079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.536374 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.537000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.537863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.540604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.600488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1320/2627] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:51.605195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.621602 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c748ac-6d15-4ff6-97bf-043475ba727a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.627835 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.628502 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1308/2628] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:51.628624 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.629017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.629424 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.630051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.631707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.638995 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.645956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1321/2629] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:51.649763 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.654868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97e180-cccd-46dc-ba48-ef19425b1eff admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.662316 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.662938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.663217 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.663527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.664177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.665773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.673365 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0f4b2-51e5-4621-9e78-d95d4617f628 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.679481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1309/2630] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:53:51.682696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.689828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.690447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.690722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.690991 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.691738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.693628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.697631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826f4a-ebe6-405f-b7cd-523056eae378 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.703153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.703918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.704276 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.704630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] PATH_INFO: `/v3/projects/0a3a0a42ee594e99aa576f847f1d25cc/users/3fe077a8ea424a78b22ee72f5fc6cb8b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.707417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1322/2631] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:51.711443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.722391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538369c4-c049-41d8-9dbf-ced70dc35a0e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:51.722567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3a0a42ee594e99aa576f847f1d25cc, user_id=3fe077a8ea424a78b22ee72f5fc6cb8b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.725307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.728039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e492d-1245-4260-97a4-33954e6f2604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:51.728773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e492d-1245-4260-97a4-33954e6f2604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.729041 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e492d-1245-4260-97a4-33954e6f2604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.729430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e492d-1245-4260-97a4-33954e6f2604 admin admin] PATH_INFO: `/v3/projects/b9cdeccb9363404983244d4e090afe7b/users/d8f7c993fd5c4f018d8251c8f0fdad1b/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.748289 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e492d-1245-4260-97a4-33954e6f2604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cdeccb9363404983244d4e090afe7b, user_id=d8f7c993fd5c4f018d8251c8f0fdad1b, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:51.752128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e492d-1245-4260-97a4-33954e6f2604 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:51.812663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1310/2632] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:51 2022] PUT /identity/v3/projects/0a3a0a42ee594e99aa576f847f1d25cc/users/3fe077a8ea424a78b22ee72f5fc6cb8b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:51.816469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:51.847277 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1323/2633] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:51 2022] PUT /identity/v3/projects/b9cdeccb9363404983244d4e090afe7b/users/d8f7c993fd5c4f018d8251c8f0fdad1b/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:51.860138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:51.860616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:51.861075 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:51.891731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] MFA Rules not processed for user `d8f7c993fd5c4f018d8251c8f0fdad1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:51.892884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:51.964513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd185e6-8514-4c68-982e-0c4c45ba501d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.038740 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1324/2634] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:52.043209 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.064498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.069922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.069922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.069922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.069922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.069922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.086579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1311/2635] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:52.092457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.118983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbad95-c958-4078-bc83-d24fe0ffab97 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.130215 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617abae6-3b51-40da-aa16-1db059ff5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.131330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617abae6-3b51-40da-aa16-1db059ff5d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.134513 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617abae6-3b51-40da-aa16-1db059ff5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.135798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617abae6-3b51-40da-aa16-1db059ff5d22 admin admin] PATH_INFO: `/v3/projects/0a3a0a42ee594e99aa576f847f1d25cc/users/3fe077a8ea424a78b22ee72f5fc6cb8b/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.141637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:52.142787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617abae6-3b51-40da-aa16-1db059ff5d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3a0a42ee594e99aa576f847f1d25cc, user_id=3fe077a8ea424a78b22ee72f5fc6cb8b, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.146180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617abae6-3b51-40da-aa16-1db059ff5d22 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.170070 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1312/2636] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:52 2022] PUT /identity/v3/projects/0a3a0a42ee594e99aa576f847f1d25cc/users/3fe077a8ea424a78b22ee72f5fc6cb8b/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:52.171884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.172183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.172462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.192576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc37802-a5d8-4113-b993-54c65444e662 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.209192 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] MFA Rules not processed for user `3fe077a8ea424a78b22ee72f5fc6cb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:52.210772 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:52.246251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:52.293606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.294882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.295406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.296085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.297324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.299687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.303694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1313/2637] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:52.320204 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.324011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:52.406735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1325/2638] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:52 2022] POST /identity/v3/projects => generated 375 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:52.409457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.411853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b26be-1ebf-4866-85b9-a49d8842bb9a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.479673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.480721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.481159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.481698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.497160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e5f1a-ac15-48b5-9a50-3f05a38ca235 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.502768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.503548 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.503833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.504114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.506711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.507129 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.563060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.564592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.579706 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1314/2639] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:52.597917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1326/2640] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:52 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:53:52.600973 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.612676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5078-4520-4f68-9f48-1482d72b6aa7 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.617569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.618842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.619263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.619575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.620230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.623172 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.635406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1315/2641] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:52.639412 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.651063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940fd3-304c-4b52-96d3-f60c0e9110ed admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.655947 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.657063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.657526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.658068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] PATH_INFO: `/v3/projects/e4c2620ee3ec45dbb8cfad0bad495503/users/554a730ead18440abb7ae9484e3f8d09/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.678303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c2620ee3ec45dbb8cfad0bad495503, user_id=554a730ead18440abb7ae9484e3f8d09, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.692204 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.779088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1327/2642] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:52 2022] PUT /identity/v3/projects/e4c2620ee3ec45dbb8cfad0bad495503/users/554a730ead18440abb7ae9484e3f8d09/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:52.783937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.797487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479931-ecd2-4445-a5db-055fff05bb9d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.814179 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:52.851967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.874611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.875237 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.875557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.875865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.876520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.878122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.891798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1316/2643] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:53:52.895978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:52.904674 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:52.907427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dcfd4-3ab8-4558-8568-368316d21f36 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.918103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4df82-b9af-42ca-be49-fa2c20236885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:52.918537 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4df82-b9af-42ca-be49-fa2c20236885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.918836 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4df82-b9af-42ca-be49-fa2c20236885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.919108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4df82-b9af-42ca-be49-fa2c20236885 admin admin] PATH_INFO: `/v3/projects/e4c2620ee3ec45dbb8cfad0bad495503/users/554a730ead18440abb7ae9484e3f8d09/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.921141 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4df82-b9af-42ca-be49-fa2c20236885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c2620ee3ec45dbb8cfad0bad495503, user_id=554a730ead18440abb7ae9484e3f8d09, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:52.923922 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4df82-b9af-42ca-be49-fa2c20236885 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:52.938079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1317/2644] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:53:52 2022] PUT /identity/v3/projects/e4c2620ee3ec45dbb8cfad0bad495503/users/554a730ead18440abb7ae9484e3f8d09/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:53:52.947356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d981aaa-5ad4-40ba-b200-49717bfa65a8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:52.948867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:52.949162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:52.949450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:52.989643 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] MFA Rules not processed for user `554a730ead18440abb7ae9484e3f8d09`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:52.990935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:53.020025 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:53.020652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:53.020951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:53.021217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:53.081281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1318/2645] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:53.092200 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:53.093927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:53.094067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:53.095934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:53.105431 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1328/2646] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:53.116177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2abc9-a5ac-4ddd-9bf3-d5496f2955a1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:53.119719 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:53.120755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:53.121231 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:53.121476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:53.200128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:53.201469 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:53.211421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1319/2647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:53:55.565816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:55.574535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6386c7-70ef-4798-b731-c9808ad03f68 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:55.578193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9380e-5119-4d84-b32d-1cf31452e7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:55.578785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9380e-5119-4d84-b32d-1cf31452e7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:55.579068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9380e-5119-4d84-b32d-1cf31452e7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:55.579349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9380e-5119-4d84-b32d-1cf31452e7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:55.637695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9380e-5119-4d84-b32d-1cf31452e7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:55.639114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9380e-5119-4d84-b32d-1cf31452e7f4 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:55.651348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1329/2648] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:56.881904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:56.908607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:56.948682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b2ed4-2c0f-4b3b-80d6-4f1dfc00c849 service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:56.953506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:56.954191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:56.954521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:56.954799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] PATH_INFO: `/v3/users/9c535aac5aeb49d2877b1caf6f844525` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:56.955959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c535aac5aeb49d2877b1caf6f844525)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:56.957865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:57.300532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c535aac5aeb49d2877b1caf6f844525'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:57.301265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c535aac5aeb49d2877b1caf6f844525'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:57.309904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c535aac5aeb49d2877b1caf6f844525'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:57.323572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c535aac5aeb49d2877b1caf6f844525'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:57.324848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c535aac5aeb49d2877b1caf6f844525'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:57.422750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1320/2649] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:56 2022] DELETE /identity/v3/users/9c535aac5aeb49d2877b1caf6f844525 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:57.427343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:57.427881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:57.427989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:57.447354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:57.448587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:57.486508 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:57.507147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1330/2650] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:57.518118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:57.519913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:57.578481 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09fe9-b58f-466b-8c59-7583ab69c805 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:57.582188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:57.582744 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:57.583029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:57.583310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:57.595223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:57.596340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:57.612027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1321/2651] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:57.665186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:57.666738 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:57.727206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ec3e3-2a81-4d90-9f28-7923de335f5a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:57.732547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:57.733150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:57.733426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:57.733695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:57.735486 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:57.798588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:57.800045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:57.820222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1331/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:53:58.088198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:58.089749 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:58.104843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7588b-9901-4332-8efe-dbd18f3659e6 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:58.109560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:58.110198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:58.110484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:58.110762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] PATH_INFO: `/v3/projects/c62c1076a9234e38b3de1a33c6463ed9` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:58.111919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62c1076a9234e38b3de1a33c6463ed9)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:58.114000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:58.201867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:58.208954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62c1076a9234e38b3de1a33c6463ed9', 'request_id': 'req-5843b112-e6cd-452f-b696-14ab032b8ead'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.217104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62c1076a9234e38b3de1a33c6463ed9', 'request_id': 'req-5843b112-e6cd-452f-b696-14ab032b8ead'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.222857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62c1076a9234e38b3de1a33c6463ed9', 'request_id': 'req-5843b112-e6cd-452f-b696-14ab032b8ead'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.308324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] The token cache is being invalidate because project c62c1076a9234e38b3de1a33c6463ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:58.308725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.309380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.311003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1322/2653] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:58 2022] DELETE /identity/v3/projects/c62c1076a9234e38b3de1a33c6463ed9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:58.315203 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:58.326897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478abe-b230-4dec-b32b-d2f0bc7cf5a2 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:58.387332 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:58.387997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:58.388278 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:58.388553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] PATH_INFO: `/v3/users/3fe077a8ea424a78b22ee72f5fc6cb8b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:58.389723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe077a8ea424a78b22ee72f5fc6cb8b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:58.391731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:58.696057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:58.705595 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe077a8ea424a78b22ee72f5fc6cb8b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.789264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe077a8ea424a78b22ee72f5fc6cb8b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.802074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe077a8ea424a78b22ee72f5fc6cb8b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.808976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe077a8ea424a78b22ee72f5fc6cb8b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.809670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c456ca81-fbc2-4936-97c9-add03fd91513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe077a8ea424a78b22ee72f5fc6cb8b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:58.815528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1332/2654] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:53:58 2022] DELETE /identity/v3/users/3fe077a8ea424a78b22ee72f5fc6cb8b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:59.239202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:59.243868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:59.255037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843b112-e6cd-452f-b696-14ab032b8ead admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:59.329619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:59.330550 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:59.330943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:59.331293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] PATH_INFO: `/v3/projects/0a3a0a42ee594e99aa576f847f1d25cc` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:59.332599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3a0a42ee594e99aa576f847f1d25cc)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:59.335240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:59.525823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3a0a42ee594e99aa576f847f1d25cc', 'request_id': 'req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:59.532226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3a0a42ee594e99aa576f847f1d25cc', 'request_id': 'req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:59.538148 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3a0a42ee594e99aa576f847f1d25cc', 'request_id': 'req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:59.608771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] The token cache is being invalidate because project 0a3a0a42ee594e99aa576f847f1d25cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:53:59.612855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:59.612855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1ffd1fe8-ba6d-4f92-80d2-e8d9bcf29564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:53:59.612855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1323/2655] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:53:59 2022] DELETE /identity/v3/projects/0a3a0a42ee594e99aa576f847f1d25cc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:53:59.616417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:59.616772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:59.617074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:59.637860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:59.638949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:59.719071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1333/2656] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:53:59.727432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:59.727904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:59.728149 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:59.748225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:53:59.749450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:53:59.757555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1324/2657] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:53:59.762458 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:59.777877 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af47df-eb79-4dfd-9b90-6973dd018fc0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:59.782642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:59.783238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:59.783556 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:59.783999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:59.784651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:53:59.784953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:59.786637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:59.802923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1334/2658] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:53:59.804165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:59.814767 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc715ac-8410-4b6b-8a29-8768c1563e28 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:59.819758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:59.820439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:59.821864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:59.821864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:59.822865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:59.825009 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:53:59.907854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1325/2659] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:53:59 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:53:59.912163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:53:59.922489 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34f78b-0a76-423b-8a27-fbe22adc66c2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:53:59.981192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:53:59.981804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:53:59.982086 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:53:59.982363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:53:59.982995 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:53:59.985002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.089654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1335/2660] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:53:59 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:00.094280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.104725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2f1bb-30e5-4531-b5fb-f4685d9bed31 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.109471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.110064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.110497 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.110675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.111318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.112940 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.123478 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1326/2661] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:00.127696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.138705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252843e6-4c66-4b37-b735-717eaaea1707 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.143442 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec356da-d2f8-4478-8b03-c56b9e03ebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.144039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec356da-d2f8-4478-8b03-c56b9e03ebf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.144324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec356da-d2f8-4478-8b03-c56b9e03ebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.144601 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec356da-d2f8-4478-8b03-c56b9e03ebf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.145242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec356da-d2f8-4478-8b03-c56b9e03ebf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.146871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec356da-d2f8-4478-8b03-c56b9e03ebf6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.156959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1336/2662] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:00.161366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.171566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd82d1-f7d0-42aa-9c01-df3b86b81d31 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.176396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.177042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.177328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.177607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] PATH_INFO: `/v3/projects/8518b362b34a4324b277101800bf7046/users/b1ddc140cab64c1b8444ef139decb9e5/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.193133 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8518b362b34a4324b277101800bf7046, user_id=b1ddc140cab64c1b8444ef139decb9e5, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.200486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.200486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:00.272473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1327/2663] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:00 2022] PUT /identity/v3/projects/8518b362b34a4324b277101800bf7046/users/b1ddc140cab64c1b8444ef139decb9e5/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:00.285345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.285633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.285960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.317605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] MFA Rules not processed for user `b1ddc140cab64c1b8444ef139decb9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:00.318816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:00.325649 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:00.389118 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1337/2664] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:00.393721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.454729 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff6e1-2b0c-4047-8d74-1d4cbfe3fc07 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.459903 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.460512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.460800 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.461076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.461709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.463668 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.555394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1328/2665] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:00 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:00.560393 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.571271 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5796f-e1c6-4c90-9c04-050f2689ea93 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.626776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.627367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.627724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.627949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.628577 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.630475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.737072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1338/2666] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:00 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:00.745527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.756337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e076cbb-a6ff-415e-bd96-a9819aa725e6 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.761907 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.762455 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.762742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.763020 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.763709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.765283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.777471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1329/2667] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:00.789581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.795010 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcb77-0e0f-4c60-8b94-7b065b8841cb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.800448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.801117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.801401 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.801679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] PATH_INFO: `/v3/projects/cc956664def040aaa87d3724f04a5b43/users/39db588d0ff94ea08ee6bf2b0f944950/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.819288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc956664def040aaa87d3724f04a5b43, user_id=39db588d0ff94ea08ee6bf2b0f944950, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.822724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.889312 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1339/2668] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:00 2022] PUT /identity/v3/projects/cc956664def040aaa87d3724f04a5b43/users/39db588d0ff94ea08ee6bf2b0f944950/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:00.893406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.904392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334560fc-2d57-4080-a0e5-5848baf30072 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:00.966389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8bf06-6bdb-41c6-b1ff-98d99c65f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:00.967007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8bf06-6bdb-41c6-b1ff-98d99c65f6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:00.967293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8bf06-6bdb-41c6-b1ff-98d99c65f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:00.967616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8bf06-6bdb-41c6-b1ff-98d99c65f6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:00.968360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8bf06-6bdb-41c6-b1ff-98d99c65f6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:00.969983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8bf06-6bdb-41c6-b1ff-98d99c65f6c3 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:00.981320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1330/2669] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:00.985387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:00.997193 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d2f9-c2f6-4bcb-b1cd-720b6662c9b1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:01.002189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:01.002840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.003155 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.003427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] PATH_INFO: `/v3/projects/cc956664def040aaa87d3724f04a5b43/users/39db588d0ff94ea08ee6bf2b0f944950/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.005538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc956664def040aaa87d3724f04a5b43, user_id=39db588d0ff94ea08ee6bf2b0f944950, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:01.010628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:01.021533 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1340/2670] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:00 2022] PUT /identity/v3/projects/cc956664def040aaa87d3724f04a5b43/users/39db588d0ff94ea08ee6bf2b0f944950/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:01.032747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dba5d-8abf-4d93-b308-4846e07c8125 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.033045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dba5d-8abf-4d93-b308-4846e07c8125 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.033324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dba5d-8abf-4d93-b308-4846e07c8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.069296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-2d2dba5d-8abf-4d93-b308-4846e07c8125 None None] MFA Rules not processed for user `39db588d0ff94ea08ee6bf2b0f944950`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:01.074271 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-2d2dba5d-8abf-4d93-b308-4846e07c8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:01.126238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:01.145826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1331/2671] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:01.158122 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:01.160014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:01.226560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d44c4-1229-487e-a734-26a7e8e73b4a admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:01.231871 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:01.241293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14c594-f807-4497-9138-bde65f95c06d None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.241579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14c594-f807-4497-9138-bde65f95c06d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.241875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14c594-f807-4497-9138-bde65f95c06d None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.243868 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1332/2672] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:54:01.245103 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.245400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.245688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.251883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.252379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.252858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.266377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:01.266377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:01.276324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:01.277704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:01.292520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1341/2673] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:01.383434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1333/2674] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:01.397523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:01.397811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:01.403119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:01.438394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:01.448484 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f4a17-c50d-4039-b33b-f580b7521fad None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:01.452164 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca42998-3508-4003-a87a-a20dfd40f518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:01.452768 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca42998-3508-4003-a87a-a20dfd40f518 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.453055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca42998-3508-4003-a87a-a20dfd40f518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.453331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca42998-3508-4003-a87a-a20dfd40f518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.455956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce88f0-eb3b-487f-9523-1c6561872793 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:01.459493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4848f-2c00-4b39-8792-551005d8be6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:01.460090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4848f-2c00-4b39-8792-551005d8be6b service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.460422 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4848f-2c00-4b39-8792-551005d8be6b service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.460701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4848f-2c00-4b39-8792-551005d8be6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.471128 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4848f-2c00-4b39-8792-551005d8be6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:01.472656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4848f-2c00-4b39-8792-551005d8be6b service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:01.483292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1342/2675] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:01.514952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca42998-3508-4003-a87a-a20dfd40f518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:01.516452 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca42998-3508-4003-a87a-a20dfd40f518 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:01.526713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1334/2676] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:54:01.752910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc9c24-d9e6-408a-a528-5503685fb700 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.753948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc9c24-d9e6-408a-a528-5503685fb700 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.753948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc9c24-d9e6-408a-a528-5503685fb700 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.755984 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1343/2677] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:54:01.761641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0c43-2d37-4bc6-b490-553e2ba8365a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.761938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0c43-2d37-4bc6-b490-553e2ba8365a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.762223 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0c43-2d37-4bc6-b490-553e2ba8365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.783771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-c0dd0c43-2d37-4bc6-b490-553e2ba8365a None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:01.791249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-c0dd0c43-2d37-4bc6-b490-553e2ba8365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:01.844611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1335/2678] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:01.856923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc9c24-d9e6-408a-a528-5503685fb700 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:01.858673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-92dc9c24-d9e6-408a-a528-5503685fb700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:01.872099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc9c24-d9e6-408a-a528-5503685fb700 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:01.875613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c85d9-eb3d-417d-862f-ae09cb368ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:01.876208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c85d9-eb3d-417d-862f-ae09cb368ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.876497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c85d9-eb3d-417d-862f-ae09cb368ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.876776 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c85d9-eb3d-417d-862f-ae09cb368ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.884915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c85d9-eb3d-417d-862f-ae09cb368ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:01.886254 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c85d9-eb3d-417d-862f-ae09cb368ce5 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:01.893992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1344/2679] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:01.987463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b12d-2dfb-4cc9-b712-d8e4b2cfde97 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.987823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b12d-2dfb-4cc9-b712-d8e4b2cfde97 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.988170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b12d-2dfb-4cc9-b712-d8e4b2cfde97 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:01.989872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1336/2680] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:54:01.996159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:01.996454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:01.997725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:02.025101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:02.026322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:02.035801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1345/2681] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:02.049498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b12d-2dfb-4cc9-b712-d8e4b2cfde97 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:02.064651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b12d-2dfb-4cc9-b712-d8e4b2cfde97 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:02.068202 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c91f96-0b30-4a9d-98fb-191afba19dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:02.068804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c91f96-0b30-4a9d-98fb-191afba19dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:02.069108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c91f96-0b30-4a9d-98fb-191afba19dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:02.069372 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c91f96-0b30-4a9d-98fb-191afba19dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:02.079576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c91f96-0b30-4a9d-98fb-191afba19dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:02.081005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c91f96-0b30-4a9d-98fb-191afba19dc5 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:02.092883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1337/2682] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:02.166069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:02.231766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49367f-27a6-414d-8729-d270639fd7c6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:02.236423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:02.237060 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:02.237335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:02.237604 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] PATH_INFO: `/v3/users/b1ddc140cab64c1b8444ef139decb9e5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:02.238727 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ddc140cab64c1b8444ef139decb9e5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:02.240665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:02.432398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ddc140cab64c1b8444ef139decb9e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.514294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ddc140cab64c1b8444ef139decb9e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.529022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ddc140cab64c1b8444ef139decb9e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.536678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ddc140cab64c1b8444ef139decb9e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.537421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ddc140cab64c1b8444ef139decb9e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.544303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1346/2683] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:02 2022] DELETE /identity/v3/users/b1ddc140cab64c1b8444ef139decb9e5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:02.548975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:02.549796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:02.550077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:02.571394 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:02.572721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:02.583804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:02.643510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1338/2684] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:02.654543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:02.654829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:02.656303 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:02.656432 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:02.663165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:02.667896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895eeea-2ca9-4e8b-8d44-9ffa02640985 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:02.672453 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:02.673079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:02.673360 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:02.673633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] PATH_INFO: `/v3/users/5ffad73a52bb4971beb81ca78ed9efd2` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:02.674747 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffad73a52bb4971beb81ca78ed9efd2)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:02.676731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:02.716652 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b81b-907c-4b02-80f4-a7bf4a8ee387 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:02.720349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a781ae-dc50-4ca7-b3cb-1f4ea730f554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:02.720956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a781ae-dc50-4ca7-b3cb-1f4ea730f554 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:02.721239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a781ae-dc50-4ca7-b3cb-1f4ea730f554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:02.721515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a781ae-dc50-4ca7-b3cb-1f4ea730f554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:02.731015 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a781ae-dc50-4ca7-b3cb-1f4ea730f554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:02.732887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a781ae-dc50-4ca7-b3cb-1f4ea730f554 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:02.742461 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1347/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:54:02.894381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffad73a52bb4971beb81ca78ed9efd2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.895034 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffad73a52bb4971beb81ca78ed9efd2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.907247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffad73a52bb4971beb81ca78ed9efd2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.931839 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffad73a52bb4971beb81ca78ed9efd2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:02.935751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffad73a52bb4971beb81ca78ed9efd2'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.044371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1339/2686] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:02 2022] DELETE /identity/v3/users/5ffad73a52bb4971beb81ca78ed9efd2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:03.049102 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:03.049578 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:03.049692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:03.069356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:03.070603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:03.132793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1348/2687] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:03.143238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:03.145169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:03.149450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:03.151324 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:03.167230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07683-eb44-4202-854f-722ce8747917 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:03.172731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:03.173380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:03.173662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:03.173939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] PATH_INFO: `/v3/projects/8518b362b34a4324b277101800bf7046` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:03.175273 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8518b362b34a4324b277101800bf7046)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:03.177211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:03.228490 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e7f4c-d1d4-4c86-95b1-b8929951e87b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:03.232357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:03.232977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:03.233260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:03.233536 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:03.243525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:03.245225 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:03.256034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1349/2688] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:03.317105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8518b362b34a4324b277101800bf7046', 'request_id': 'req-e2590cab-2e11-45f0-8214-20736dc4312a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.324000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8518b362b34a4324b277101800bf7046', 'request_id': 'req-e2590cab-2e11-45f0-8214-20736dc4312a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.329914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8518b362b34a4324b277101800bf7046', 'request_id': 'req-e2590cab-2e11-45f0-8214-20736dc4312a'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.428358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] The token cache is being invalidate because project 8518b362b34a4324b277101800bf7046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:03.434307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.434307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.434307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1340/2689] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:03 2022] DELETE /identity/v3/projects/8518b362b34a4324b277101800bf7046 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:03.435927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:03.445994 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34817a1d-8c73-46ab-9b54-0e5e4ef399af service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:03.499723 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:03.510224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:03.511077 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:03.511414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:03.511761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] PATH_INFO: `/v3/users/39db588d0ff94ea08ee6bf2b0f944950` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:03.512975 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39db588d0ff94ea08ee6bf2b0f944950)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:03.514999 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:03.677623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:03.682685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:03.696649 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2590cab-2e11-45f0-8214-20736dc4312a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:03.716806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:03.717697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:03.718047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:03.718399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] PATH_INFO: `/v3/projects/f1081acbbbb843a19ed01e3a999d664d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:03.719722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1081acbbbb843a19ed01e3a999d664d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:03.721854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:03.733676 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:03.748586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39db588d0ff94ea08ee6bf2b0f944950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.820653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39db588d0ff94ea08ee6bf2b0f944950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.835523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39db588d0ff94ea08ee6bf2b0f944950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.841841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1081acbbbb843a19ed01e3a999d664d', 'request_id': 'req-76ccad7d-a419-4e67-8ef1-c2607dca3045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.849645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39db588d0ff94ea08ee6bf2b0f944950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.849834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1081acbbbb843a19ed01e3a999d664d', 'request_id': 'req-76ccad7d-a419-4e67-8ef1-c2607dca3045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.850526 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39db588d0ff94ea08ee6bf2b0f944950'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.855725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1081acbbbb843a19ed01e3a999d664d', 'request_id': 'req-76ccad7d-a419-4e67-8ef1-c2607dca3045'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.856669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1350/2690] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:03 2022] DELETE /identity/v3/users/39db588d0ff94ea08ee6bf2b0f944950 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:03.930311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] The token cache is being invalidate because project f1081acbbbb843a19ed01e3a999d664d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:03.931170 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.932145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:03.936015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1341/2691] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:03 2022] DELETE /identity/v3/projects/f1081acbbbb843a19ed01e3a999d664d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:03.939918 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:03.941771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:04.012184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60270cb-69ac-4470-b619-f8543531f38d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:04.016728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:04.028626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.028626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.028626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] PATH_INFO: `/v3/users/d8f7c993fd5c4f018d8251c8f0fdad1b` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.028626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f7c993fd5c4f018d8251c8f0fdad1b)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:04.028626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:04.246565 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f7c993fd5c4f018d8251c8f0fdad1b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.297116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:04.299889 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:04.321283 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f7c993fd5c4f018d8251c8f0fdad1b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.339240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f7c993fd5c4f018d8251c8f0fdad1b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.341542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:04.349658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f7c993fd5c4f018d8251c8f0fdad1b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.356459 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8b195994-3a2c-42f5-8352-381154800713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f7c993fd5c4f018d8251c8f0fdad1b'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.357546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1351/2692] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:03 2022] DELETE /identity/v3/users/d8f7c993fd5c4f018d8251c8f0fdad1b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:04.382864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccad7d-a419-4e67-8ef1-c2607dca3045 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:04.446078 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:04.446717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.447005 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.447286 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] PATH_INFO: `/v3/projects/cc956664def040aaa87d3724f04a5b43` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.449140 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc956664def040aaa87d3724f04a5b43)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:04.451043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:04.601042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:04.605060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc956664def040aaa87d3724f04a5b43', 'request_id': 'req-30114dfd-27eb-4581-91a4-84ad17833861'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.611558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc956664def040aaa87d3724f04a5b43', 'request_id': 'req-30114dfd-27eb-4581-91a4-84ad17833861'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.617570 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc956664def040aaa87d3724f04a5b43', 'request_id': 'req-30114dfd-27eb-4581-91a4-84ad17833861'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.714812 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] The token cache is being invalidate because project cc956664def040aaa87d3724f04a5b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:04.715493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.717266 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-30114dfd-27eb-4581-91a4-84ad17833861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:04.718930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1342/2693] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:04 2022] DELETE /identity/v3/projects/cc956664def040aaa87d3724f04a5b43 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:04.723981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.724290 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.724573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.747641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:04.749434 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:04.825346 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1352/2694] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:04.832632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.833012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.833296 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.856758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:04.857920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:04.872830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1343/2695] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:04.877770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:04.893670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1553d7-c4c7-4db3-8b59-d8046c35d811 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:04.902436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:04.904922 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:04.905092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:04.905363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.905714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.906119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.906895 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:54:04.907294 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:04.914504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:04.921012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f9778-580c-47e6-94cf-210453a49b33 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:04.927752 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:04.928401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.928841 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.929124 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] PATH_INFO: `/v3/projects/b9cdeccb9363404983244d4e090afe7b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.930399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cdeccb9363404983244d4e090afe7b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:04.933267 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:04.952889 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1353/2696] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:54:04.954976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:04.975336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee4dd-c52f-4bc8-a015-49ca66a12d24 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:04.986052 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:04.986363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:04.986644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:04.986919 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:04.988168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:04.989472 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.085986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cdeccb9363404983244d4e090afe7b', 'request_id': 'req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.092875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cdeccb9363404983244d4e090afe7b', 'request_id': 'req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.099153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cdeccb9363404983244d4e090afe7b', 'request_id': 'req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.122084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1354/2697] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:04 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:05.126181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.163937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] The token cache is being invalidate because project b9cdeccb9363404983244d4e090afe7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:05.164300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.165056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.166764 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1344/2698] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:04 2022] DELETE /identity/v3/projects/b9cdeccb9363404983244d4e090afe7b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:05.170632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.172046 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:05.195466 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8002a-53f8-4164-9e9d-2e1ec5b78849 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.201824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.202607 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.203267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.203267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.203829 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.205748 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.239684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6fc7-2eb5-4c82-8466-4ccbdc632d98 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.244322 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.245604 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.245898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.246196 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] PATH_INFO: `/v3/users/554a730ead18440abb7ae9484e3f8d09` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.247331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554a730ead18440abb7ae9484e3f8d09)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.249283 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.280931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1355/2699] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:05 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:54:05.285078 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.286698 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:05.302950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648067f1-afec-4846-84f5-a71d94443a71 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.309003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.312006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.312006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.312006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.312006 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.312736 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.324555 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1356/2700] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:54:05.328315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.338475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc39d-7551-4b57-ac5e-8f1f8a9d8daa admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.343581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.344162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.344445 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.344786 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.345412 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.346989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.361207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1357/2701] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:54:05.366957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.377920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8609-7b78-486c-8b13-8a265cd71646 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.382631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcce22e-8e45-4d3a-a738-4345fb388fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.383265 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcce22e-8e45-4d3a-a738-4345fb388fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.383576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcce22e-8e45-4d3a-a738-4345fb388fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.383853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcce22e-8e45-4d3a-a738-4345fb388fda admin admin] PATH_INFO: `/v3/projects/eb8b87d1d0b7401ea7140cbca01e862c/users/e0d15458ab944e36b59e9fa1ae8edbf0/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.398609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcce22e-8e45-4d3a-a738-4345fb388fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8b87d1d0b7401ea7140cbca01e862c, user_id=e0d15458ab944e36b59e9fa1ae8edbf0, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.401387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcce22e-8e45-4d3a-a738-4345fb388fda admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.446368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554a730ead18440abb7ae9484e3f8d09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.447081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554a730ead18440abb7ae9484e3f8d09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.449619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:05.454955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554a730ead18440abb7ae9484e3f8d09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.455502 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:05.460966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1358/2702] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:05 2022] PUT /identity/v3/projects/eb8b87d1d0b7401ea7140cbca01e862c/users/e0d15458ab944e36b59e9fa1ae8edbf0/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:05.467721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554a730ead18440abb7ae9484e3f8d09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.468450 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-2341fc3d-9d40-454b-bb90-6ba91c429d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554a730ead18440abb7ae9484e3f8d09'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:05.472864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.473132 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.473410 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.502139 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] MFA Rules not processed for user `e0d15458ab944e36b59e9fa1ae8edbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:05.503496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:05.535185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1345/2703] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:05 2022] DELETE /identity/v3/users/554a730ead18440abb7ae9484e3f8d09 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:05.572739 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1359/2704] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:05.574159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.574439 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.574713 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.585703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.588049 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:05.602832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:05.606579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:05.649416 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da3b0-bc0d-40d8-b90b-95b1cf57487b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.664875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1346/2705] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:05.678236 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:05.679718 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:05.700001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88827d02-571a-4c6d-a5e4-a64192fc0408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.700638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827d02-571a-4c6d-a5e4-a64192fc0408 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.701298 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827d02-571a-4c6d-a5e4-a64192fc0408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.701869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827d02-571a-4c6d-a5e4-a64192fc0408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.754354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8be51-8f97-4dcb-a979-8a77148bd2d1 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:05.760016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:05.761562 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:05.762075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:05.762572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:05.770863 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88827d02-571a-4c6d-a5e4-a64192fc0408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.772165 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:05.772815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88827d02-571a-4c6d-a5e4-a64192fc0408 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.773755 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:05.778136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=100 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:05.784307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1347/2706] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:54:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:54:05.790949 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1360/2707] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:54:06.038037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:06.039978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:06.181225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc7cb-7c74-4d79-bbc4-350d70687529 service swift] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:06.186824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:06.187499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:06.187788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:06.188102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] PATH_INFO: `/v3/projects/e4c2620ee3ec45dbb8cfad0bad495503` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:06.189257 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c2620ee3ec45dbb8cfad0bad495503)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:06.191168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:06.193815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:06.337967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c2620ee3ec45dbb8cfad0bad495503', 'request_id': 'req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:06.347882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c2620ee3ec45dbb8cfad0bad495503', 'request_id': 'req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:06.355228 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c2620ee3ec45dbb8cfad0bad495503', 'request_id': 'req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:06.461395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] The token cache is being invalidate because project e4c2620ee3ec45dbb8cfad0bad495503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:06.466690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:06.466690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-87845d77-c9aa-4d47-b2ab-35c3e9ff51b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:06.466690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1348/2708] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:06 2022] DELETE /identity/v3/projects/e4c2620ee3ec45dbb8cfad0bad495503 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:06.469735 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:06.470238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:06.470368 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:06.491516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:06.493043 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:06.607646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1361/2709] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:06.612935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:06.613259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:06.613526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:06.647777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:06.648188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:06.657951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1349/2710] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:06.661923 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:06.689619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c392cdd-48cf-48a4-949a-c18a31b98ec4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:06.694568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:06.695190 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:06.695511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:06.695793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:06.697134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:54:06.697134 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:06.698771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:06.711987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1362/2711] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:54:06.717418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:06.727220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ddc11-87f6-4bde-bc83-bc5ac784dba5 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:06.733397 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:06.734337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:06.738108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:06.738108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:06.738108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:06.738108 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:06.817399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1350/2712] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:06 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:06.822480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:06.838242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd51eb-e2e6-4b9f-8e04-c5266cbec569 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:06.923751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:06.924811 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:06.925257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:06.925696 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:06.926497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:06.928955 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:07.025106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1363/2713] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:06 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:07.030855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:07.053567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d1837-ad71-47ac-a5e0-e3f87192411a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:07.064168 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:07.064823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:07.068833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:07.068833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:07.068833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:07.068833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:07.087391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:07.091761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1351/2714] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:07.098754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60e460-aa5d-49ff-a124-ab2d976cf667 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:07.104552 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15630-5fd3-4bb2-845f-f96af36b5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:07.105163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15630-5fd3-4bb2-845f-f96af36b5226 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:07.105441 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15630-5fd3-4bb2-845f-f96af36b5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:07.105720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15630-5fd3-4bb2-845f-f96af36b5226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:07.106361 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15630-5fd3-4bb2-845f-f96af36b5226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:07.108585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15630-5fd3-4bb2-845f-f96af36b5226 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:07.121869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1364/2715] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:07.129457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:07.143750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926b5c-6533-4342-a737-bf1b68de378b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:07.149107 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:07.149773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:07.150055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:07.150388 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] PATH_INFO: `/v3/projects/594bf167057f42a49a096827dd939805/users/a9ebf1c74844438081935f75514b21f2/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:07.168979 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] RBAC: Authorizing `identity:create_grant(project_id=594bf167057f42a49a096827dd939805, user_id=a9ebf1c74844438081935f75514b21f2, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:07.173358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:07.255985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1352/2716] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:07 2022] PUT /identity/v3/projects/594bf167057f42a49a096827dd939805/users/a9ebf1c74844438081935f75514b21f2/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:07.269017 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:07.269471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:07.269588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:07.340510 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] MFA Rules not processed for user `a9ebf1c74844438081935f75514b21f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:07.342048 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:07.459180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:07.482545 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1365/2717] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:07.487348 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:07.489248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:07.581794 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae8d0-504f-452e-82a5-78b09620330f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:07.585983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209c983-df44-40b0-aa55-79d98564ad35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:07.586610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c983-df44-40b0-aa55-79d98564ad35 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:07.586891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c983-df44-40b0-aa55-79d98564ad35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:07.587250 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c983-df44-40b0-aa55-79d98564ad35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:07.597326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c983-df44-40b0-aa55-79d98564ad35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:07.598756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c983-df44-40b0-aa55-79d98564ad35 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:07.608736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1353/2718] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:13.088633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:13.090088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:13.164827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ece7f-f211-4ce6-acfc-a3e32f518ca8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:13.170742 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:13.171421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:13.171708 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:13.171989 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] PATH_INFO: `/v3/users/e0d15458ab944e36b59e9fa1ae8edbf0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:13.173170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d15458ab944e36b59e9fa1ae8edbf0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:13.175108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:13.378454 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d15458ab944e36b59e9fa1ae8edbf0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:13.458259 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d15458ab944e36b59e9fa1ae8edbf0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:13.480253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d15458ab944e36b59e9fa1ae8edbf0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:13.509568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d15458ab944e36b59e9fa1ae8edbf0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:13.510842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d15458ab944e36b59e9fa1ae8edbf0'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:13.521464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1366/2719] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:13 2022] DELETE /identity/v3/users/e0d15458ab944e36b59e9fa1ae8edbf0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:13.523357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:13.523901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:13.524011 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:13.550671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:13.552272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:13.587501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:13.649627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1354/2720] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:13.668007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:13.668007 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:13.753447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab331-b2f7-4d25-b92d-db30b4422b36 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:13.763353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e410c0-6ae8-4e5f-8205-5840a8cc92b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:13.764912 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e410c0-6ae8-4e5f-8205-5840a8cc92b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:13.765362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e410c0-6ae8-4e5f-8205-5840a8cc92b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:13.765798 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e410c0-6ae8-4e5f-8205-5840a8cc92b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:13.777178 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e410c0-6ae8-4e5f-8205-5840a8cc92b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:13.779547 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e410c0-6ae8-4e5f-8205-5840a8cc92b3 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:13.797567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1367/2721] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:15.185856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:15.187544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:15.205840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70614e-75ca-4db6-994d-d8e4959b7baa None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:15.211519 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:15.212408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.212756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.213157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] PATH_INFO: `/v3/projects/eb8b87d1d0b7401ea7140cbca01e862c` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.214423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8b87d1d0b7401ea7140cbca01e862c)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:15.216479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:15.336292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8b87d1d0b7401ea7140cbca01e862c', 'request_id': 'req-f1e54c04-13d1-4a98-89d1-820c361f0937'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:15.344268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8b87d1d0b7401ea7140cbca01e862c', 'request_id': 'req-f1e54c04-13d1-4a98-89d1-820c361f0937'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:15.351818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8b87d1d0b7401ea7140cbca01e862c', 'request_id': 'req-f1e54c04-13d1-4a98-89d1-820c361f0937'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:15.466551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] The token cache is being invalidate because project eb8b87d1d0b7401ea7140cbca01e862c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:15.467261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:15.468576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-f1e54c04-13d1-4a98-89d1-820c361f0937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:15.470393 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1355/2722] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:15 2022] DELETE /identity/v3/projects/eb8b87d1d0b7401ea7140cbca01e862c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:15.475207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.475778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.475886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.503639 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:15.505105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:15.516771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:15.566379 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1368/2723] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:15.575975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.576249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.576536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.597185 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:15.598447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:15.606558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1356/2724] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:54:15.610806 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:15.620191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf47a6c-b9a2-48bf-91d5-f8ff55adbae6 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:15.625267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:15.625866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.626146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.626426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.627071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:54:15.627391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:15.628996 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:15.641569 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1369/2725] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:54:15.646144 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:15.656123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abf49a-0cf5-4036-a411-5bd4717660b9 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:15.660678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:15.661280 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.661769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.661896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.662578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:15.664545 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:15.751670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1357/2726] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:15 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:15.755630 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:15.766343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1542c-5008-4caa-8c1b-50054783fc69 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:15.826886 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:15.832542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.832542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.832542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.832542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:15.832542 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:15.936237 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1370/2727] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:15 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:54:15.937159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:15.948851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a593cf-ebe2-4210-b45b-b364c9bbf9da admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:15.954145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:15.954756 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:15.955043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:15.955318 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:15.956030 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:15.957934 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:15.978242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1358/2728] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:54:15.980373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:15.991824 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d683e-1bf8-4d4c-984a-41dc4f5544dd admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:15.999066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217a90-e620-400e-92df-db86f70dd238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:16.004144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217a90-e620-400e-92df-db86f70dd238 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:16.004144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217a90-e620-400e-92df-db86f70dd238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:16.004144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217a90-e620-400e-92df-db86f70dd238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:16.004144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217a90-e620-400e-92df-db86f70dd238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:16.004144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217a90-e620-400e-92df-db86f70dd238 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:16.020216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1371/2729] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:16.023958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:16.037590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fd6f-4423-41c2-8b22-0b67979d7bfd admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:16.039861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:16.040555 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:16.040835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:16.041281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] PATH_INFO: `/v3/projects/363590143caf4c9eaf1ca300745c05b1/users/48d109e5799f432c88c1f46b986bea12/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:16.058817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] RBAC: Authorizing `identity:create_grant(project_id=363590143caf4c9eaf1ca300745c05b1, user_id=48d109e5799f432c88c1f46b986bea12, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:16.065884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:16.144882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1359/2730] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:16 2022] PUT /identity/v3/projects/363590143caf4c9eaf1ca300745c05b1/users/48d109e5799f432c88c1f46b986bea12/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:16.157655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:16.157943 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:16.158218 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:16.188223 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] MFA Rules not processed for user `48d109e5799f432c88c1f46b986bea12`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:16.189449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:16.263467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1372/2731] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:16.274566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:16.276363 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:16.334330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb4c4-e0b8-4d92-8e18-7caba611553f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:16.337896 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34928-ea07-4596-a309-a8e79ec96e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:16.338650 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34928-ea07-4596-a309-a8e79ec96e86 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:16.338938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34928-ea07-4596-a309-a8e79ec96e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:16.339216 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34928-ea07-4596-a309-a8e79ec96e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:16.345410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:16.349589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34928-ea07-4596-a309-a8e79ec96e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:16.353155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34928-ea07-4596-a309-a8e79ec96e86 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:16.360262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1360/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:19.856764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:19.858180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:19.871202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:19.923571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1030-16da-4bfb-82a8-819393e9c421 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:19.928901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:19.929655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:19.930036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:19.930413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] PATH_INFO: `/v3/users/a9ebf1c74844438081935f75514b21f2` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:19.931761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ebf1c74844438081935f75514b21f2)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:19.933686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:20.137384 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ebf1c74844438081935f75514b21f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.220411 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ebf1c74844438081935f75514b21f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.233977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ebf1c74844438081935f75514b21f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.240890 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ebf1c74844438081935f75514b21f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.241553 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ebf1c74844438081935f75514b21f2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.247788 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1373/2733] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:19 2022] DELETE /identity/v3/users/a9ebf1c74844438081935f75514b21f2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:20.252330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:20.252851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:20.252960 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:20.272278 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:20.273480 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:20.333597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1361/2734] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:20.344291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:20.345701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:20.403903 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf4cee-3a47-4f35-9f5d-5228b3efb08d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:20.407391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7df342-05b0-4957-986d-8ebdb50120b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:20.407987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7df342-05b0-4957-986d-8ebdb50120b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:20.408268 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7df342-05b0-4957-986d-8ebdb50120b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:20.408540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7df342-05b0-4957-986d-8ebdb50120b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:20.417327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7df342-05b0-4957-986d-8ebdb50120b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:20.419353 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7df342-05b0-4957-986d-8ebdb50120b1 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:20.428870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1374/2735] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:20.842787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:20.844310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:20.858262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd5b2-c4e1-4924-938e-9510a778d2db None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:20.862913 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:20.863579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:20.863867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:20.864146 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] PATH_INFO: `/v3/projects/594bf167057f42a49a096827dd939805` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:20.865389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594bf167057f42a49a096827dd939805)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:20.867486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:20.969694 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594bf167057f42a49a096827dd939805', 'request_id': 'req-509a2336-a8ec-428b-8083-e0e308317127'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.975829 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594bf167057f42a49a096827dd939805', 'request_id': 'req-509a2336-a8ec-428b-8083-e0e308317127'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:20.981840 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594bf167057f42a49a096827dd939805', 'request_id': 'req-509a2336-a8ec-428b-8083-e0e308317127'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:21.100392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] The token cache is being invalidate because project 594bf167057f42a49a096827dd939805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:21.100709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:21.101332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:21.102818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1362/2736] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:20 2022] DELETE /identity/v3/projects/594bf167057f42a49a096827dd939805 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:21.294351 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:21.294915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:21.294915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:21.315681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:21.316819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:21.351046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:21.379491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1375/2737] 10.222.0.17 () {58 vars in 967 bytes} [Wed Sep 7 14:54:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:21.392226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:21.393609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:21.470380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a2336-a8ec-428b-8083-e0e308317127 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:21.475670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110e5ad-289d-4eea-a5c6-d77ab6e9a4ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:21.476291 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e5ad-289d-4eea-a5c6-d77ab6e9a4ab service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:21.476576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e5ad-289d-4eea-a5c6-d77ab6e9a4ab service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:21.476854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e5ad-289d-4eea-a5c6-d77ab6e9a4ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:21.487796 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e5ad-289d-4eea-a5c6-d77ab6e9a4ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:21.488708 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e5ad-289d-4eea-a5c6-d77ab6e9a4ab service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:21.502717 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1363/2738] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:54:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 14:54:31.334094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:31.335579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:31.400173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6244995-0ebc-4acf-a42b-0bdbd636801b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:31.405338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:31.405960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:31.406243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:31.406518 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] PATH_INFO: `/v3/users/48d109e5799f432c88c1f46b986bea12` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:31.407677 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d109e5799f432c88c1f46b986bea12)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:31.409592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:31.497985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:31.607959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d109e5799f432c88c1f46b986bea12'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:31.680095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d109e5799f432c88c1f46b986bea12'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:31.693108 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d109e5799f432c88c1f46b986bea12'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:31.700693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d109e5799f432c88c1f46b986bea12'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:31.701430 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d109e5799f432c88c1f46b986bea12'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:31.707253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1376/2739] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:31 2022] DELETE /identity/v3/users/48d109e5799f432c88c1f46b986bea12 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:31.711802 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:31.712125 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:31.712412 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:31.732310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:31.733525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:31.797126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1364/2740] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:31.806866 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:31.808305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:31.865147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021ec94-3ce3-4670-9f5e-97561774563f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:31.868837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1d53-f665-4323-861f-7ab9a34edd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:31.869474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1d53-f665-4323-861f-7ab9a34edd35 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:31.869760 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1d53-f665-4323-861f-7ab9a34edd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:31.870071 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1d53-f665-4323-861f-7ab9a34edd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:31.879528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1d53-f665-4323-861f-7ab9a34edd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:31.880960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1d53-f665-4323-861f-7ab9a34edd35 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:31.885880 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:31.891423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1377/2741] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:32.297732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:32.300040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:32.318758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9607-a9e0-4db7-9838-a06b5c19ac64 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:32.324616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:32.332048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:32.332048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:32.332048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] PATH_INFO: `/v3/projects/363590143caf4c9eaf1ca300745c05b1` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:32.332048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363590143caf4c9eaf1ca300745c05b1)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:32.332048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:32.458382 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363590143caf4c9eaf1ca300745c05b1', 'request_id': 'req-a616a383-3ff9-4570-a4c1-dbba2c488514'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:32.464551 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363590143caf4c9eaf1ca300745c05b1', 'request_id': 'req-a616a383-3ff9-4570-a4c1-dbba2c488514'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:32.471218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363590143caf4c9eaf1ca300745c05b1', 'request_id': 'req-a616a383-3ff9-4570-a4c1-dbba2c488514'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:32.542420 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] The token cache is being invalidate because project 363590143caf4c9eaf1ca300745c05b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:32.543053 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:32.543327 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-a616a383-3ff9-4570-a4c1-dbba2c488514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:32.545637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1365/2742] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:32 2022] DELETE /identity/v3/projects/363590143caf4c9eaf1ca300745c05b1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:32.550609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:32.551050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:32.551152 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:32.571171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:32.572525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:32.631021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1378/2743] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:32.639997 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:32.640294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:32.640576 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:32.660061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:32.661261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:32.669776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1366/2744] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:32.674081 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:32.683854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3d8c-264e-44dd-ad3c-ce75770c4fda None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:32.689249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:32.689841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:32.690126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:32.690426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:32.691067 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:54:32.691391 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:32.692979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:32.704669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1379/2745] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:54:32.709258 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:32.718927 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4767aa-d958-4a51-8812-d9b2c1ae7eac None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:32.723583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:32.724174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:32.724457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:32.724732 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:32.725371 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:32.727248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:32.839955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1367/2746] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:32 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:32.844908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:32.854850 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d6c3-adba-43ea-a246-0be789ae07fb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:32.909957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:32.910574 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:32.910857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:32.911133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:32.911815 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:32.913773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.018693 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1380/2747] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:32 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:33.023065 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.034156 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967d3d-9385-4dfb-9dc1-fd83b291bf3c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.038854 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.039472 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.044690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.044690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.044690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.044690 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.053467 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1368/2748] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:33.057557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.067718 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dca1e5-4b39-4760-a6ce-4ab9ec1b6127 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.072368 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97041975-f3e2-4bca-812c-ca03e8153fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.072959 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041975-f3e2-4bca-812c-ca03e8153fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.073242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041975-f3e2-4bca-812c-ca03e8153fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.073517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041975-f3e2-4bca-812c-ca03e8153fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.074158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97041975-f3e2-4bca-812c-ca03e8153fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.075826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97041975-f3e2-4bca-812c-ca03e8153fd2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.087681 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1381/2749] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 14:54:33.092334 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.102837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e95ef-d98d-44c1-a3c8-89ef7ebc5438 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.108304 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.108954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.109242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.109523 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] PATH_INFO: `/v3/projects/94310b78290c4fab9f36d5b05ba0678f/users/c1d792b40a1b4f2fabd1fc91d2c41429/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.126757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94310b78290c4fab9f36d5b05ba0678f, user_id=c1d792b40a1b4f2fabd1fc91d2c41429, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.129446 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.211711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1369/2750] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:33 2022] PUT /identity/v3/projects/94310b78290c4fab9f36d5b05ba0678f/users/c1d792b40a1b4f2fabd1fc91d2c41429/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:33.223047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.223327 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.223688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.250584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] MFA Rules not processed for user `c1d792b40a1b4f2fabd1fc91d2c41429`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:33.251808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:33.305389 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:33.314152 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1382/2751] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:33.323064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.345664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:33.384834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fab14-c292-444f-84c7-a490c4a1031f admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.390051 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.390652 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.390932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.391205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.391872 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.393833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.502104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1370/2752] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:33 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:33.506288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.517673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a996-a444-40df-a0ac-2ed68354c1c4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.579598 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.580194 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.580404 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.580675 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.581316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.583260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.675363 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1383/2753] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:33 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:33.679325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.690462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc824f4-5cee-46ef-9a98-af378be39944 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.695135 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.695762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.696043 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.696315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.696954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.698517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.709492 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1371/2754] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:33.713664 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.723997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c2f3c-60ff-4328-8c5c-a70846131905 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.728475 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70fd04-9af6-4a90-aed5-05c69a29cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.729062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70fd04-9af6-4a90-aed5-05c69a29cadb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.729343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70fd04-9af6-4a90-aed5-05c69a29cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.729612 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70fd04-9af6-4a90-aed5-05c69a29cadb admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.730243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70fd04-9af6-4a90-aed5-05c69a29cadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.731869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70fd04-9af6-4a90-aed5-05c69a29cadb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.741583 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1384/2755] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:33.745387 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:33.755471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db71afb-4933-49a8-9891-53dd7a3bfd99 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:33.759932 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:33.760557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.760837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.761106 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] PATH_INFO: `/v3/projects/be289d8f478342aa8580197e94b4ebfc/users/093d12e0ba8a4047888d3d652c574c1d/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.775789 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be289d8f478342aa8580197e94b4ebfc, user_id=093d12e0ba8a4047888d3d652c574c1d, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:33.778381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:33.843656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1372/2756] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:33 2022] PUT /identity/v3/projects/be289d8f478342aa8580197e94b4ebfc/users/093d12e0ba8a4047888d3d652c574c1d/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:33.910249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:33.910535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:33.910849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:33.939851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] MFA Rules not processed for user `093d12e0ba8a4047888d3d652c574c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:33.941063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:34.003646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1385/2757] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:34.008131 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.073338 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb491b3-297b-405b-ae3b-7489b362236d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.077999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.078600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.078880 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.079153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.079830 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.081742 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.171147 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1373/2758] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:34 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:34.175180 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.186699 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149e68-05da-48d1-8c68-c974e084bfde None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.242828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.243491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.243778 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.244053 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.244694 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.246656 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.257328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:34.375266 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1386/2759] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:34 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:34.379524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.390092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceac0b-78f1-41b7-a053-641754c393ae admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.394522 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.395109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.395415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.395696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.396325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.397959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.408762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1374/2760] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:34.412878 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.423697 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25fba8-7945-4dba-81a4-c079fcc0ee15 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.428245 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.428887 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.429171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.429449 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] PATH_INFO: `/v3/projects/221d0ac56bea473386c6f85010489506/users/b7fc0b1a1c4045fe9ecadc6df2a8e9c5/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.444001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221d0ac56bea473386c6f85010489506, user_id=b7fc0b1a1c4045fe9ecadc6df2a8e9c5, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.446645 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.503286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1387/2761] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:34 2022] PUT /identity/v3/projects/221d0ac56bea473386c6f85010489506/users/b7fc0b1a1c4045fe9ecadc6df2a8e9c5/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:34.507419 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.517860 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7701-f699-4da2-8a61-b33c437d3e25 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.560487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:34.574950 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109334f-b9c0-4db2-80da-d82d4297bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.575610 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109334f-b9c0-4db2-80da-d82d4297bbef admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.576045 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109334f-b9c0-4db2-80da-d82d4297bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.576329 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109334f-b9c0-4db2-80da-d82d4297bbef admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.576970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109334f-b9c0-4db2-80da-d82d4297bbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.578560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109334f-b9c0-4db2-80da-d82d4297bbef admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.588674 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1375/2762] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:34.593213 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.603821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3654bfa-32ea-4900-940d-0b6e67ca72d3 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.609013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.609665 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.609946 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.610336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] PATH_INFO: `/v3/projects/221d0ac56bea473386c6f85010489506/users/b7fc0b1a1c4045fe9ecadc6df2a8e9c5/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.612299 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221d0ac56bea473386c6f85010489506, user_id=b7fc0b1a1c4045fe9ecadc6df2a8e9c5, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.614914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.625232 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1388/2763] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:34 2022] PUT /identity/v3/projects/221d0ac56bea473386c6f85010489506/users/b7fc0b1a1c4045fe9ecadc6df2a8e9c5/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:34.635300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.635625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.635910 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.666114 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] MFA Rules not processed for user `b7fc0b1a1c4045fe9ecadc6df2a8e9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:34.667335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:34.739180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1376/2764] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:34.750692 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:34.752700 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:34.812272 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8206e3-cb66-4de1-baf9-b36aba0c64e7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:34.815833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:34.816438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:34.816715 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:34.827292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:34.874849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:34.876316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:34.885402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1389/2765] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:36.840670 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:36.843086 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:36.854817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5551-684f-4c0a-b4e7-89df2339857d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:36.858797 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:36.859421 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:36.859705 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:36.859978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:36.916558 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:36.918040 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:36.927725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1377/2766] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:38.407910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:38.416701 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69702f8-e11e-494c-91a8-af752377aeda service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:38.420833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e188085-fe57-452d-8773-d01e76c95871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:38.421427 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188085-fe57-452d-8773-d01e76c95871 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:38.421707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188085-fe57-452d-8773-d01e76c95871 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:38.421978 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188085-fe57-452d-8773-d01e76c95871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:38.430816 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188085-fe57-452d-8773-d01e76c95871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:38.432264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188085-fe57-452d-8773-d01e76c95871 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:38.442376 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1390/2767] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:43.061310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:43.138972 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa67a71-2bee-4f78-9177-32affd7f1dce service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:43.143590 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:43.144220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:43.144506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:43.144781 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] PATH_INFO: `/v3/users/c1d792b40a1b4f2fabd1fc91d2c41429` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:43.145898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d792b40a1b4f2fabd1fc91d2c41429)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:43.147835 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:43.152471 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=100 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:43.348975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d792b40a1b4f2fabd1fc91d2c41429'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:43.349623 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d792b40a1b4f2fabd1fc91d2c41429'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:43.356680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d792b40a1b4f2fabd1fc91d2c41429'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:43.369090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d792b40a1b4f2fabd1fc91d2c41429'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:43.369765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d792b40a1b4f2fabd1fc91d2c41429'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:43.456188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1378/2768] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:43 2022] DELETE /identity/v3/users/c1d792b40a1b4f2fabd1fc91d2c41429 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:54:43.460640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:43.461115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:43.461243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:43.480236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:43.481440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:43.535766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:43.544925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1391/2769] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:43.558727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:43.560240 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:43.620174 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fa797-7acb-41c6-8c0f-cb46ba50f6f0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:43.623641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:43.624262 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:43.624541 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:43.624811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:43.634663 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:43.636112 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:43.645508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1379/2770] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:44.071140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:44.072608 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:44.085654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46dbd4-3b62-4329-a886-2cfc54ab8a30 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:44.090137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:44.090774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:44.091058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:44.091335 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] PATH_INFO: `/v3/projects/94310b78290c4fab9f36d5b05ba0678f` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:44.092496 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=94310b78290c4fab9f36d5b05ba0678f)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:44.096841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:44.206550 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94310b78290c4fab9f36d5b05ba0678f', 'request_id': 'req-ef4de459-f193-4d79-9f70-d6d0028b3fcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.272097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94310b78290c4fab9f36d5b05ba0678f', 'request_id': 'req-ef4de459-f193-4d79-9f70-d6d0028b3fcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.278113 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94310b78290c4fab9f36d5b05ba0678f', 'request_id': 'req-ef4de459-f193-4d79-9f70-d6d0028b3fcb'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.289841 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] The token cache is being invalidate because project 94310b78290c4fab9f36d5b05ba0678f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:44.290127 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.290819 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.292340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1392/2771] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:44 2022] DELETE /identity/v3/projects/94310b78290c4fab9f36d5b05ba0678f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:44.296321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:44.306097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e4030-e18f-4623-8f44-ce06ce981ff5 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:44.362867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:44.363535 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:44.363823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:44.364102 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] PATH_INFO: `/v3/users/093d12e0ba8a4047888d3d652c574c1d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:44.365220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=093d12e0ba8a4047888d3d652c574c1d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:44.367123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:44.457563 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:44.550991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093d12e0ba8a4047888d3d652c574c1d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.551683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093d12e0ba8a4047888d3d652c574c1d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.558462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093d12e0ba8a4047888d3d652c574c1d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.570599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093d12e0ba8a4047888d3d652c574c1d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.571244 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093d12e0ba8a4047888d3d652c574c1d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:44.655177 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1380/2772] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:44 2022] DELETE /identity/v3/users/093d12e0ba8a4047888d3d652c574c1d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:45.078163 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:45.079852 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:45.093655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de459-f193-4d79-9f70-d6d0028b3fcb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:45.151269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:45.151931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:45.152215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:45.152492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] PATH_INFO: `/v3/projects/be289d8f478342aa8580197e94b4ebfc` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:45.153638 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be289d8f478342aa8580197e94b4ebfc)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:45.155566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:45.258276 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be289d8f478342aa8580197e94b4ebfc', 'request_id': 'req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.470147 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be289d8f478342aa8580197e94b4ebfc', 'request_id': 'req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.476400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be289d8f478342aa8580197e94b4ebfc', 'request_id': 'req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.487623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] The token cache is being invalidate because project be289d8f478342aa8580197e94b4ebfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:45.487910 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.488567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.490035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1393/2773] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:45 2022] DELETE /identity/v3/projects/be289d8f478342aa8580197e94b4ebfc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:45.494061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:45.495592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:45.508681 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1599-ba71-4c48-9f44-67275a586b0c admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:45.563571 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:45.565003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:45.565486 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:45.565976 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] PATH_INFO: `/v3/users/b7fc0b1a1c4045fe9ecadc6df2a8e9c5` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:45.568345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fc0b1a1c4045fe9ecadc6df2a8e9c5)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:45.572886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:45.775697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fc0b1a1c4045fe9ecadc6df2a8e9c5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.777031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fc0b1a1c4045fe9ecadc6df2a8e9c5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.783331 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fc0b1a1c4045fe9ecadc6df2a8e9c5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.795989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fc0b1a1c4045fe9ecadc6df2a8e9c5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.796627 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-c7a78159-a679-42be-b231-4a1de675b8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fc0b1a1c4045fe9ecadc6df2a8e9c5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:45.869017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1381/2774] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:45 2022] DELETE /identity/v3/users/b7fc0b1a1c4045fe9ecadc6df2a8e9c5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:46.293836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:46.295303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:46.308725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48bbf7-443f-4b30-a7f0-2dd60a1dd1e4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:46.318756 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:46.368354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:46.369009 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:46.369288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:46.369561 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] PATH_INFO: `/v3/projects/221d0ac56bea473386c6f85010489506` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:46.370660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=221d0ac56bea473386c6f85010489506)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:46.372581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:46.481188 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221d0ac56bea473386c6f85010489506', 'request_id': 'req-a1298630-a480-4815-892e-534be4360c9d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:46.566861 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221d0ac56bea473386c6f85010489506', 'request_id': 'req-a1298630-a480-4815-892e-534be4360c9d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:46.572858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221d0ac56bea473386c6f85010489506', 'request_id': 'req-a1298630-a480-4815-892e-534be4360c9d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:46.584186 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] The token cache is being invalidate because project 221d0ac56bea473386c6f85010489506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:46.584474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:46.585154 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a1298630-a480-4815-892e-534be4360c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:46.586769 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1394/2775] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:46 2022] DELETE /identity/v3/projects/221d0ac56bea473386c6f85010489506 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:46.591814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:46.592288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:46.592411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:46.612503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:46.613954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:46.632901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:46.674129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1382/2776] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:46.684062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:46.693862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:46.693862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:46.705131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:46.706557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:46.714480 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1395/2777] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:46.718963 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:46.728580 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901cd9-75da-4182-ac06-33508be9e72d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:46.733055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:46.733644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:46.734119 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:46.734557 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:46.735660 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:54:46.735983 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:46.738248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:46.751272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1383/2778] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 14:54:46.756074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:46.765255 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136abdc-3b35-4c82-bc1e-80a56393d00b None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:46.769993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:46.770758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:46.770898 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:46.771164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:46.771853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:46.774092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:46.868992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1396/2779] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:54:46 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:54:46.873330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:46.883955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f4e3-78ad-4468-8be1-58eaf168da6d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:46.946564 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:46.947178 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:46.947501 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:46.947782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:46.948415 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:46.950323 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:47.049438 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1384/2780] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:54:46 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:54:47.054159 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:47.064603 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095355-0650-418b-81ef-a6e9f1ac78f9 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:47.069614 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:47.070210 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:47.070492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:47.070881 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:47.071566 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:47.073162 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:47.083436 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1397/2781] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:47.087324 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:47.098354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf48f6-c5ae-4830-83e0-cf99bf65c6bb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:47.102991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655ee7-99e1-469d-8ff6-f2efe46ac305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:47.103626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655ee7-99e1-469d-8ff6-f2efe46ac305 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:47.103914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655ee7-99e1-469d-8ff6-f2efe46ac305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:47.104191 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655ee7-99e1-469d-8ff6-f2efe46ac305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:47.104834 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655ee7-99e1-469d-8ff6-f2efe46ac305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:47.106451 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655ee7-99e1-469d-8ff6-f2efe46ac305 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:47.117605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1385/2782] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:54:47.121987 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:47.132532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eadf6-54b4-4788-b47f-c7a4cb6420a4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:47.137543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:47.137668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:47.137932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:47.138205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] PATH_INFO: `/v3/projects/270acbfc87d64fd5ad17f2311ad9f2a8/users/df980e79223e40d4bf2c629fdb88f900/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:47.152826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] RBAC: Authorizing `identity:create_grant(project_id=270acbfc87d64fd5ad17f2311ad9f2a8, user_id=df980e79223e40d4bf2c629fdb88f900, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:47.155710 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:47.252226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1398/2783] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:54:47 2022] PUT /identity/v3/projects/270acbfc87d64fd5ad17f2311ad9f2a8/users/df980e79223e40d4bf2c629fdb88f900/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:47.262596 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:47.262890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:47.263175 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:47.291494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] MFA Rules not processed for user `df980e79223e40d4bf2c629fdb88f900`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:47.292723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:47.356914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1386/2784] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:47.368224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:47.369931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:47.413930 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:47.428805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768977e0-b8df-44e8-9b23-a242198a407e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:47.432423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7cdf-5f1c-4d5e-a5ff-c6f237dae84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:47.433019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7cdf-5f1c-4d5e-a5ff-c6f237dae84e service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:47.433303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7cdf-5f1c-4d5e-a5ff-c6f237dae84e service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:47.433573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7cdf-5f1c-4d5e-a5ff-c6f237dae84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:47.441772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7cdf-5f1c-4d5e-a5ff-c6f237dae84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:47.443195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7cdf-5f1c-4d5e-a5ff-c6f237dae84e service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:47.452651 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1399/2785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:50.519704 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:50.540882 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:50.584858 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a1cb-143a-42f4-aaf2-4c3632709b0f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:50.589608 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:50.590261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:50.590547 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:50.590826 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] PATH_INFO: `/v3/users/df980e79223e40d4bf2c629fdb88f900` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:50.591965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df980e79223e40d4bf2c629fdb88f900)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:50.594199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:50.772055 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df980e79223e40d4bf2c629fdb88f900'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:50.772709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df980e79223e40d4bf2c629fdb88f900'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:50.779626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df980e79223e40d4bf2c629fdb88f900'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:50.792012 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df980e79223e40d4bf2c629fdb88f900'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:50.792678 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df980e79223e40d4bf2c629fdb88f900'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:50.868952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1387/2786] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:54:50 2022] DELETE /identity/v3/users/df980e79223e40d4bf2c629fdb88f900 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:54:50.873619 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00937096-098f-418f-aab7-e6564697910a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:50.874105 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00937096-098f-418f-aab7-e6564697910a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:50.874219 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00937096-098f-418f-aab7-e6564697910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:50.894331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-00937096-098f-418f-aab7-e6564697910a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:54:50.895904 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-00937096-098f-418f-aab7-e6564697910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:50.955450 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1400/2787] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:54:50.965757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:50.967224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:51.025603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c61eb-0c6f-49f8-9369-131246b0d1b0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:51.029413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4965256-27c9-4712-8dca-e1c290b3c05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:51.030056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965256-27c9-4712-8dca-e1c290b3c05a service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:51.030340 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965256-27c9-4712-8dca-e1c290b3c05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:51.030621 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965256-27c9-4712-8dca-e1c290b3c05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:51.040308 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4965256-27c9-4712-8dca-e1c290b3c05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:51.041738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4965256-27c9-4712-8dca-e1c290b3c05a service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:51.051357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1388/2788] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:54:51.490342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00937096-098f-418f-aab7-e6564697910a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:54:51.493468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-00937096-098f-418f-aab7-e6564697910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:54:51.510409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00937096-098f-418f-aab7-e6564697910a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:54:51.515263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:54:51.516609 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:54:51.516908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:54:51.517191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] PATH_INFO: `/v3/projects/270acbfc87d64fd5ad17f2311ad9f2a8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:54:51.518341 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270acbfc87d64fd5ad17f2311ad9f2a8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:54:51.520956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:54:51.642950 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270acbfc87d64fd5ad17f2311ad9f2a8', 'request_id': 'req-fdc67193-d93d-40dd-ad12-61ad0d561012'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:51.715165 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270acbfc87d64fd5ad17f2311ad9f2a8', 'request_id': 'req-fdc67193-d93d-40dd-ad12-61ad0d561012'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:51.721932 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270acbfc87d64fd5ad17f2311ad9f2a8', 'request_id': 'req-fdc67193-d93d-40dd-ad12-61ad0d561012'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:51.733172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] The token cache is being invalidate because project 270acbfc87d64fd5ad17f2311ad9f2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:54:51.733417 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:51.734068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:54:51.735590 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1401/2789] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:54:51 2022] DELETE /identity/v3/projects/270acbfc87d64fd5ad17f2311ad9f2a8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:55:01.046943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:01.730314 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:02.157307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:55:02.157791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:55:02.157893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:55:02.178828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] MFA Rules not processed for user `9af91bc5d8c04abdb605e513f5a94a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:55:02.180104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:55:02.234510 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1389/2790] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:55:11.521885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:55:11.523340 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:55:11.667002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67193-d93d-40dd-ad12-61ad0d561012 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:55:11.672479 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:55:11.673195 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:55:11.673594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:55:11.673872 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:55:11.676452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:55:11.688228 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:55:11.689793 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8009-bf68-4494-a0e4-7e90f5a88010 service placement] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:55:11.699821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1402/2791] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:55:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:55:12.227987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=25 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:16.077121 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:55:16.079087 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:55:16.220270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392f299-e3d1-4686-ac74-9ce8db78bbf6 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:55:16.226350 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c129868b68642ccab8686ed6fe22906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:55:16.230461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:55:16.230461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:55:16.230461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:55:16.230461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:55:16.242253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:55:16.243864 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:55:16.254828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1390/2792] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:55:21.695686 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=63 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:26.250226 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=58 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:07.778657 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1310f-da1e-4d67-a718-e0b37ace38bd None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:07.779168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1310f-da1e-4d67-a718-e0b37ace38bd None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:07.779288 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1310f-da1e-4d67-a718-e0b37ace38bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:07.812759 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-68a1310f-da1e-4d67-a718-e0b37ace38bd None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:56:07.814137 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-68a1310f-da1e-4d67-a718-e0b37ace38bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:07.884631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1403/2793] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:56:08.060110 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:56:08.061639 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:08.142263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2744-2440-4651-89a9-71ab5af8fd69 service nova] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:56:08.147938 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dbb6e-c44f-414f-8899-871652167ae6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:56:08.148554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dbb6e-c44f-414f-8899-871652167ae6 service swift] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:08.148828 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dbb6e-c44f-414f-8899-871652167ae6 service swift] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:08.149111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dbb6e-c44f-414f-8899-871652167ae6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:08.158599 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dbb6e-c44f-414f-8899-871652167ae6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:56:08.160288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dbb6e-c44f-414f-8899-871652167ae6 service swift] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:56:08.168775 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1391/2794] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:17.868484 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=29 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:18.165410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=32 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:24.562669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03ed4-b7f6-425f-b5af-ab041fb5bc25 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:24.563264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03ed4-b7f6-425f-b5af-ab041fb5bc25 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:24.563264 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03ed4-b7f6-425f-b5af-ab041fb5bc25 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:24.564728 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1404/2795] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 14:56:24.570520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d454ca-b4c0-4974-93a2-9db58a103306 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:24.571023 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d454ca-b4c0-4974-93a2-9db58a103306 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:24.571137 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d454ca-b4c0-4974-93a2-9db58a103306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:24.602403 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-39d454ca-b4c0-4974-93a2-9db58a103306 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:56:24.603636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-39d454ca-b4c0-4974-93a2-9db58a103306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:24.612743 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1392/2796] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:56:24.625131 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03ed4-b7f6-425f-b5af-ab041fb5bc25 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:56:24.626808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c6d03ed4-b7f6-425f-b5af-ab041fb5bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:24.689064 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03ed4-b7f6-425f-b5af-ab041fb5bc25 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:56:24.692570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac3593-1c2d-485f-b547-c6350dfcbc76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:56:24.693174 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac3593-1c2d-485f-b547-c6350dfcbc76 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:24.693457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac3593-1c2d-485f-b547-c6350dfcbc76 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:24.693734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac3593-1c2d-485f-b547-c6350dfcbc76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:24.704257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac3593-1c2d-485f-b547-c6350dfcbc76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:56:24.705676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac3593-1c2d-485f-b547-c6350dfcbc76 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:56:24.716330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1405/2797] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:56:24.930517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ee51-c1c6-48d1-ab99-2b21ddf9fee3 None None] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:24.930769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ee51-c1c6-48d1-ab99-2b21ddf9fee3 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:24.931054 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ee51-c1c6-48d1-ab99-2b21ddf9fee3 None None] PATH_INFO: `/` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:24.932584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1393/2798] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:56:24.937428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f894e-f4c5-40b4-aa3a-f5b2f79de305 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:24.937720 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f894e-f4c5-40b4-aa3a-f5b2f79de305 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:24.938001 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f894e-f4c5-40b4-aa3a-f5b2f79de305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:24.970706 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-c80f894e-f4c5-40b4-aa3a-f5b2f79de305 None None] MFA Rules not processed for user `b3493b21604b404391be7b8909461d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:56:24.971859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c80f894e-f4c5-40b4-aa3a-f5b2f79de305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:25.032543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1406/2799] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:56:25.045169 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529ee51-c1c6-48d1-ab99-2b21ddf9fee3 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:56:25.046862 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1529ee51-c1c6-48d1-ab99-2b21ddf9fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:25.060581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529ee51-c1c6-48d1-ab99-2b21ddf9fee3 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:56:25.064103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3327b-63c8-4ae9-ab1a-500059b14080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:56:25.064725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3327b-63c8-4ae9-ab1a-500059b14080 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:25.065013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3327b-63c8-4ae9-ab1a-500059b14080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:25.065332 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3327b-63c8-4ae9-ab1a-500059b14080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:25.073099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3327b-63c8-4ae9-ab1a-500059b14080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:56:25.074508 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3327b-63c8-4ae9-ab1a-500059b14080 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:56:25.082230 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1394/2800] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:56:25.165473 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad1d7-68d5-485c-9823-aa39387d7422 None None] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:25.165762 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad1d7-68d5-485c-9823-aa39387d7422 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:25.166045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad1d7-68d5-485c-9823-aa39387d7422 None None] PATH_INFO: `/` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:25.167421 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1407/2801] 10.222.0.17 () {54 vars in 921 bytes} [Wed Sep 7 14:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 14:56:25.172256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9a83-fbb0-4f1c-9732-8c7a8daa2c37 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:25.172543 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9a83-fbb0-4f1c-9732-8c7a8daa2c37 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:25.172817 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9a83-fbb0-4f1c-9732-8c7a8daa2c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:25.192776 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0e2f9a83-fbb0-4f1c-9732-8c7a8daa2c37 None None] MFA Rules not processed for user `2c129868b68642ccab8686ed6fe22906`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:56:25.193958 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0e2f9a83-fbb0-4f1c-9732-8c7a8daa2c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:25.203560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1395/2802] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Sep 7 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:56:25.213911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ad1d7-68d5-485c-9823-aa39387d7422 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:56:25.225291 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ad1d7-68d5-485c-9823-aa39387d7422 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:56:25.229596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:56:25.230214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:25.230497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:25.230798 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:25.241058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:56:25.243170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:56:25.253865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1408/2803] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:56:27.669759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44928-6c47-4c08-927a-9bfc88468052 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:27.670254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44928-6c47-4c08-927a-9bfc88468052 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:27.670357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44928-6c47-4c08-927a-9bfc88468052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:27.689689 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-4da44928-6c47-4c08-927a-9bfc88468052 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:56:27.690898 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4da44928-6c47-4c08-927a-9bfc88468052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:27.698482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1396/2804] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Sep 7 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:56:27.711153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:56:27.722712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a25c1-ff1f-486e-bd5c-15adb2acdcaa service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:56:27.728222 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:56:27.728808 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:27.729087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:27.729358 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:27.737224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:56:27.738781 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:56:27.746705 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1409/2805] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:37.684799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=19 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:37.743571 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=70 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:41.669625 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:41.670118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:41.670245 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:41.689495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] MFA Rules not processed for user `279a7226767e4381be66397afd481061`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:56:41.690750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:56:41.698229 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1397/2806] 10.222.0.17 () {58 vars in 967 bytes} [Wed Sep 7 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:56:41.710837 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:56:41.722094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3452be2-9fd0-4566-bceb-71fe0bb0fd35 service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:56:41.727285 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac16c8f79f7748ffa341705c05f28e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:56:41.727897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:56:41.728175 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:56:41.728447 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:56:41.736366 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:56:41.737963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:56:41.745836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1410/2807] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Sep 7 14:56:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:51.684385 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:51.742667 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:10.734682 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:10.745182 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127ed75-822a-4937-bba4-9573151b8ea2 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:10.748914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:10.749609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:10.749893 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:10.750167 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:10.752130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:10.767917 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:10.769404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:10.781129 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1398/2808] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:11.968097 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:11.982170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41781793-4932-4a9d-8172-8bf9ebee094f service swift] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:11.987088 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:11.988050 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:11.988517 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:11.988962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:11.990773 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:12.007177 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:12.008653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:12.020435 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1411/2809] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:20.776014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:22.015469 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=6 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:22.308651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:22.310294 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:22.409072 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923cec-5123-42b2-b375-a39a413ea65d service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:22.413669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:22.414292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:22.414572 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:22.414845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] PATH_INFO: `/v3/users/4931f582f451481ea99bc6d4de78a6bf` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:22.416090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4931f582f451481ea99bc6d4de78a6bf)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:22.418103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:22.612189 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4931f582f451481ea99bc6d4de78a6bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:22.612777 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4931f582f451481ea99bc6d4de78a6bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:22.619653 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4931f582f451481ea99bc6d4de78a6bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:22.631440 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4931f582f451481ea99bc6d4de78a6bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:22.632081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4931f582f451481ea99bc6d4de78a6bf'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:22.717798 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1399/2810] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:22 2022] DELETE /identity/v3/users/4931f582f451481ea99bc6d4de78a6bf => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:22.982315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:22.993965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305584bd-6af5-4dc1-b688-3bcd644559d4 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:23.051211 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:23.052101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:23.052101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:23.052354 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] PATH_INFO: `/v3/projects/901a8d4d0b384afbb779974c128d1292` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:23.053491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901a8d4d0b384afbb779974c128d1292)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:23.055392 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:23.166021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901a8d4d0b384afbb779974c128d1292', 'request_id': 'req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.237112 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901a8d4d0b384afbb779974c128d1292', 'request_id': 'req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.243173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901a8d4d0b384afbb779974c128d1292', 'request_id': 'req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.255477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] The token cache is being invalidate because project 901a8d4d0b384afbb779974c128d1292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:23.255771 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.256409 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.257948 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1412/2811] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:22 2022] DELETE /identity/v3/projects/901a8d4d0b384afbb779974c128d1292 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:57:23.261980 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:23.263457 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:23.277259 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4a4a-d441-4c54-b37b-c8945dbf4424 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:23.324591 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:23.334207 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:23.335003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:23.338066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:23.338066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] PATH_INFO: `/v3/users/e4a392d0ae0e4475ba6426552ae8deab` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:23.338066 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a392d0ae0e4475ba6426552ae8deab)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:23.338715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:23.565939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a392d0ae0e4475ba6426552ae8deab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.566589 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a392d0ae0e4475ba6426552ae8deab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.573757 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a392d0ae0e4475ba6426552ae8deab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.586579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a392d0ae0e4475ba6426552ae8deab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.587701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a392d0ae0e4475ba6426552ae8deab'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:23.695811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1400/2812] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:23 2022] DELETE /identity/v3/users/e4a392d0ae0e4475ba6426552ae8deab => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:23.930707 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:23.932600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:23.947981 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f23ea-b009-4eea-9fa1-fd2833b5c8e5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:24.008387 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:24.009019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:24.009296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:24.009568 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] PATH_INFO: `/v3/projects/b30433fcd5d34f30a2bd14d58b93b3f5` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:24.010663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30433fcd5d34f30a2bd14d58b93b3f5)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:24.012573 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:24.078179 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:24.090082 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30433fcd5d34f30a2bd14d58b93b3f5', 'request_id': 'req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:24.140893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30433fcd5d34f30a2bd14d58b93b3f5', 'request_id': 'req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:24.146867 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30433fcd5d34f30a2bd14d58b93b3f5', 'request_id': 'req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:24.158352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] The token cache is being invalidate because project b30433fcd5d34f30a2bd14d58b93b3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:24.158854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:24.160020 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:24.161514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1413/2813] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:23 2022] DELETE /identity/v3/projects/b30433fcd5d34f30a2bd14d58b93b3f5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:24.467619 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:24.469003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:24.547970 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3984274-4018-44b3-bcf8-aaf788841c20 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:24.594921 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:24.596080 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:24.596364 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:24.596746 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:24.598463 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:24.618103 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:24.655577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:24.657126 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:24.666900 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1401/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:24.766613 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:24.768672 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:24.825531 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ada83-bc6a-4ffc-a276-a22ffddf14c2 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:24.829079 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:24.829679 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:24.830125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:24.830635 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:24.832491 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:24.894858 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:24.896322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:24.906011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1414/2815] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:28.243211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:28.244769 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:28.261227 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b8497-0f41-44c8-9cde-a5e75bfe309d service cinder] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:28.265723 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:28.266347 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:28.266629 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:28.266904 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] PATH_INFO: `/v3/users/9af91bc5d8c04abdb605e513f5a94a2d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:28.268814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af91bc5d8c04abdb605e513f5a94a2d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:28.270890 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:28.452503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af91bc5d8c04abdb605e513f5a94a2d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:28.453090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af91bc5d8c04abdb605e513f5a94a2d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:28.460759 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af91bc5d8c04abdb605e513f5a94a2d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:28.472737 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af91bc5d8c04abdb605e513f5a94a2d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:28.473402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-ee50c483-dc0f-41ec-87a9-d1dc6502c978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af91bc5d8c04abdb605e513f5a94a2d'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:28.540578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1402/2816] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:28 2022] DELETE /identity/v3/users/9af91bc5d8c04abdb605e513f5a94a2d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:57:28.793003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:28.805274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215c4b9-c2d7-4e31-8adb-a1e54925d07b service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:28.864688 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:28.865343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:28.865633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:28.865908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] PATH_INFO: `/v3/projects/2bc07568f6284b2bb34af01c9e04a779` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:28.867014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc07568f6284b2bb34af01c9e04a779)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:28.868958 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:28.880791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:29.011036 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc07568f6284b2bb34af01c9e04a779', 'request_id': 'req-402f645f-7358-4ac7-af30-dee5be738aee'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:29.076854 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc07568f6284b2bb34af01c9e04a779', 'request_id': 'req-402f645f-7358-4ac7-af30-dee5be738aee'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:29.082849 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc07568f6284b2bb34af01c9e04a779', 'request_id': 'req-402f645f-7358-4ac7-af30-dee5be738aee'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:29.094242 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] The token cache is being invalidate because project 2bc07568f6284b2bb34af01c9e04a779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:29.094535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:29.095164 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-402f645f-7358-4ac7-af30-dee5be738aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:29.097274 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1415/2817] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:28 2022] DELETE /identity/v3/projects/2bc07568f6284b2bb34af01c9e04a779 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:29.102405 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.104038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.104038 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.150325 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:29.151607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:29.211989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1403/2818] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:29.219957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.220239 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.221024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.241402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:29.242586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:29.250166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1416/2819] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:29.254516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.264295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741dd00-8bfc-45ed-8ab5-96ec91abcf2a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.269381 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.269978 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.270263 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.270540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.271188 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:57:29.271534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.273122 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:29.280041 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:29.284924 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1404/2820] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:57:29.293557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.303440 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369755c-877a-4119-8850-e6a72af0a646 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.307953 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.308540 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.308817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.309087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.309719 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.311676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:29.434523 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1417/2821] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:29 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:57:29.438531 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.449253 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc461fd-038f-4d85-a4cd-3e63c992a359 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.510753 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.511395 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.511687 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.511967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.512611 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.514573 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:29.586477 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1405/2822] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:29 2022] POST /identity/v3/users => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:29.590606 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.601382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b625f88-677c-4931-aed7-df2961f04972 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.606262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.606857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.607136 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.607439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.608074 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.609757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:29.620296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1418/2823] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:29.624351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.635013 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27b493-33d5-4cdf-9ba8-a596b159ce85 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.639691 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6566ceb-f2d7-49c8-bbda-8e5ffb5da2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.640284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6566ceb-f2d7-49c8-bbda-8e5ffb5da2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.640567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6566ceb-f2d7-49c8-bbda-8e5ffb5da2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.640842 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6566ceb-f2d7-49c8-bbda-8e5ffb5da2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.641479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6566ceb-f2d7-49c8-bbda-8e5ffb5da2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.643225 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6566ceb-f2d7-49c8-bbda-8e5ffb5da2ca admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:29.653771 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1406/2824] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:29.657801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.668205 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51935294-bbfa-4339-bf40-8e2fdca26d1f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.672587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.674171 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.674596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.674951 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] PATH_INFO: `/v3/projects/33895a619878497497f9b223e8399ec3/users/d708958ae092495db22c7c8208ca8bfc/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.689181 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33895a619878497497f9b223e8399ec3, user_id=d708958ae092495db22c7c8208ca8bfc, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.692217 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:29.787443 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1419/2825] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:29 2022] PUT /identity/v3/projects/33895a619878497497f9b223e8399ec3/users/d708958ae092495db22c7c8208ca8bfc/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:29.797520 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.797814 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.798117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.826313 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] MFA Rules not processed for user `d708958ae092495db22c7c8208ca8bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:29.827598 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:29.899151 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1407/2826] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:29.903726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:29.966444 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d34c0-cd01-4cf2-ac2e-427e3a932a60 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:29.971882 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:29.972482 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:29.972761 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:29.973034 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:29.973659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:29.975839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.070076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1420/2827] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:29 2022] POST /identity/v3/projects => generated 403 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:30.072482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.084845 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4a58-ff50-412e-8aae-98c6f218fc29 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.149300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.149920 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.150203 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.150479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.151134 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.153101 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.165849 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:30.267218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1408/2828] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:30 2022] POST /identity/v3/users => generated 308 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:30.272216 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.282537 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe9dc4-8675-4074-a944-4bd6bc188fc6 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.288099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.288695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.288973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.289269 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.289906 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.291538 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.302483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1421/2829] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:30.306693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.316805 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b0fa-8036-4019-a472-addd899bc6d7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.321396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.322049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.322333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.322635 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] PATH_INFO: `/v3/projects/29d5baf9965b475d8ad31ffd3150d67d/users/46d21d198af44d00ac982131460c45b6/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.338235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d5baf9965b475d8ad31ffd3150d67d, user_id=46d21d198af44d00ac982131460c45b6, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.341026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.416261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1409/2830] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:30 2022] PUT /identity/v3/projects/29d5baf9965b475d8ad31ffd3150d67d/users/46d21d198af44d00ac982131460c45b6/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:30.420344 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.425772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:30.432801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03d1f-c7b8-48d7-bf9f-ef2e1287580d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.488464 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2adab2-d16d-4167-a7dd-43afe6a3de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.489063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2adab2-d16d-4167-a7dd-43afe6a3de5e admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.489349 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2adab2-d16d-4167-a7dd-43afe6a3de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.489621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2adab2-d16d-4167-a7dd-43afe6a3de5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.490249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2adab2-d16d-4167-a7dd-43afe6a3de5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.491873 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2adab2-d16d-4167-a7dd-43afe6a3de5e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.501325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1422/2831] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:30.506083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.516150 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c910ef-54fd-4d50-8193-6da96c466bc1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.521482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.522067 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.522349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.522686 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] PATH_INFO: `/v3/projects/29d5baf9965b475d8ad31ffd3150d67d/users/46d21d198af44d00ac982131460c45b6/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.524584 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d5baf9965b475d8ad31ffd3150d67d, user_id=46d21d198af44d00ac982131460c45b6, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.527171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.537311 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1410/2832] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:30 2022] PUT /identity/v3/projects/29d5baf9965b475d8ad31ffd3150d67d/users/46d21d198af44d00ac982131460c45b6/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:30.548367 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.548687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.548967 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.578197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] MFA Rules not processed for user `46d21d198af44d00ac982131460c45b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:30.579429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:30.645945 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1423/2833] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:30.658379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.658667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:30.715707 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a7f93-79a9-4de4-bd5f-d8d0c3fd6eb1 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.719488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afe274-39d0-4b9e-8012-27457c285e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.720099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afe274-39d0-4b9e-8012-27457c285e16 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.720377 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afe274-39d0-4b9e-8012-27457c285e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.720671 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afe274-39d0-4b9e-8012-27457c285e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.729801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afe274-39d0-4b9e-8012-27457c285e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.731214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afe274-39d0-4b9e-8012-27457c285e16 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:30.740712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1411/2834] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:30.872779 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:30.935859 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7a982-0e62-4b72-8ca5-0b1250701a53 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:30.941494 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:30.942119 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:30.942402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:30.942680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] PATH_INFO: `/v3/users/d708958ae092495db22c7c8208ca8bfc` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:30.943827 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d708958ae092495db22c7c8208ca8bfc)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:30.945732 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:31.062013 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:31.188826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd708958ae092495db22c7c8208ca8bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.266897 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd708958ae092495db22c7c8208ca8bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.279768 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd708958ae092495db22c7c8208ca8bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.287426 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd708958ae092495db22c7c8208ca8bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.288144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd708958ae092495db22c7c8208ca8bfc'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.294161 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1424/2835] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:30 2022] DELETE /identity/v3/users/d708958ae092495db22c7c8208ca8bfc => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:31.299330 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:31.299819 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:31.299918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:31.318824 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:31.319993 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:31.379489 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1412/2836] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:31.389182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:31.390661 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:31.448790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e684-b90e-4685-91c5-d7e2ae3492f4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:31.452336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:31.452941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:31.453224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:31.453499 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:31.462584 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:31.464057 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:31.473893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1425/2837] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:31.856974 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:31.863295 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:31.873252 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd59e-1121-4a14-9e65-b4b74eaf3d1c None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:31.878268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:31.879064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:31.879220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:31.879536 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] PATH_INFO: `/v3/projects/33895a619878497497f9b223e8399ec3` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:31.880715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33895a619878497497f9b223e8399ec3)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:31.882738 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:31.988418 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33895a619878497497f9b223e8399ec3', 'request_id': 'req-25cb2382-8d7c-4120-abc0-4abe72753ad5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.994823 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33895a619878497497f9b223e8399ec3', 'request_id': 'req-25cb2382-8d7c-4120-abc0-4abe72753ad5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:31.996948 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:32.000773 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33895a619878497497f9b223e8399ec3', 'request_id': 'req-25cb2382-8d7c-4120-abc0-4abe72753ad5'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.072336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] The token cache is being invalidate because project 33895a619878497497f9b223e8399ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:32.072631 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.073272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.074760 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1413/2838] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:31 2022] DELETE /identity/v3/projects/33895a619878497497f9b223e8399ec3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:32.078741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:32.089011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791735-cead-4b4f-b80d-0beaebd463fe service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:32.145658 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:32.146212 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:32.146485 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:32.146754 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] PATH_INFO: `/v3/users/46d21d198af44d00ac982131460c45b6` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:32.147888 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d21d198af44d00ac982131460c45b6)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:32.149805 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:32.274238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d21d198af44d00ac982131460c45b6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.275901 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:32.339684 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d21d198af44d00ac982131460c45b6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.352338 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d21d198af44d00ac982131460c45b6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.359120 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d21d198af44d00ac982131460c45b6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.359782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-dd1ca7d2-ebdc-4dd4-ac5e-ffff1f7db2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d21d198af44d00ac982131460c45b6'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:32.366201 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1426/2839] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:32 2022] DELETE /identity/v3/users/46d21d198af44d00ac982131460c45b6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:32.799696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:32.803201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:32.818885 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2382-8d7c-4120-abc0-4abe72753ad5 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:32.894209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:32.894877 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:32.895162 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:32.895473 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] PATH_INFO: `/v3/projects/29d5baf9965b475d8ad31ffd3150d67d` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:32.896657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d5baf9965b475d8ad31ffd3150d67d)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:32.898714 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.051661 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d5baf9965b475d8ad31ffd3150d67d', 'request_id': 'req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:33.059560 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d5baf9965b475d8ad31ffd3150d67d', 'request_id': 'req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:33.066379 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d5baf9965b475d8ad31ffd3150d67d', 'request_id': 'req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:33.170867 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] The token cache is being invalidate because project 29d5baf9965b475d8ad31ffd3150d67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:33.171358 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:33.172352 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-80267812-aa8b-4596-abf7-d0ed6d4bb2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:33.175073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1414/2840] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:32 2022] DELETE /identity/v3/projects/29d5baf9965b475d8ad31ffd3150d67d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:57:33.180301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.180796 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.180969 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.203596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:33.205731 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:33.273019 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1427/2841] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:33.280888 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.281292 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.281566 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.302665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:33.303827 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:33.313326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1415/2842] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:33.318343 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:33.328654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3b0c-8dcd-4a95-a12d-4dee08a87b4a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:33.333687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:33.336262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.336262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.336262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.336262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:57:33.336262 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:33.337650 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.351724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1428/2843] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:57:33.356145 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:33.369725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f0a55-03fc-457a-969c-3a8e906bb1bb None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:33.379014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:33.379656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.379942 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.380218 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.380876 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:33.383142 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.492696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1416/2844] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:33 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:33.497058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:33.509541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343133e-c60a-49fb-861e-06ecc9407e38 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:33.583184 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:33.583791 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.584073 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.584342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.585090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:33.587407 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.695695 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1429/2845] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:33 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:57:33.699833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:33.710408 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad66cb-fdb4-4e62-989f-3e4a67417fad admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:33.714906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:33.715633 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.715918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.716193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.716833 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:33.718409 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.729297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1417/2846] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:33.733140 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:33.744021 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0243-3dbb-4ee6-88a4-269d0623ec39 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:33.748588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60290732-1ee9-4fd8-8cab-47c1c1629d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:33.749173 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60290732-1ee9-4fd8-8cab-47c1c1629d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.749452 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60290732-1ee9-4fd8-8cab-47c1c1629d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.749725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60290732-1ee9-4fd8-8cab-47c1c1629d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.750355 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60290732-1ee9-4fd8-8cab-47c1c1629d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:33.751977 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60290732-1ee9-4fd8-8cab-47c1c1629d2b admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.762575 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1430/2847] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:33.766616 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:33.777620 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6c1b1-38b3-4ab5-b67d-1f99167c5ed7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:33.782506 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:33.783808 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.784092 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.784368 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] PATH_INFO: `/v3/projects/be8cce16c7ed4465bd0d4c80ba5f855b/users/8759b652633543f0bcb7a3e727a471f8/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.798675 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8cce16c7ed4465bd0d4c80ba5f855b, user_id=8759b652633543f0bcb7a3e727a471f8, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:33.801709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:33.907193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1418/2848] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:33 2022] PUT /identity/v3/projects/be8cce16c7ed4465bd0d4c80ba5f855b/users/8759b652633543f0bcb7a3e727a471f8/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:33.919509 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:33.923095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:33.923095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:33.953836 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] MFA Rules not processed for user `8759b652633543f0bcb7a3e727a471f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:33.955833 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:33.976703 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:34.022979 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1431/2849] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:34.027488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.040763 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:34.091813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2d7f3-a741-4f7f-b469-78f8bdf3193e admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.096961 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.097594 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.097878 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.098153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.098810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.100988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.181494 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1419/2850] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:34 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:34.185260 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.196405 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0a22-8646-4cf6-a65d-6155d739f556 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.257998 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.258640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.258917 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.259191 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.259862 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.261770 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.346333 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1432/2851] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:34 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:34.350630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.360806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0934-36a0-4f3a-8468-b17a12519730 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.366256 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.366848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.367130 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.367424 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.368060 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.369626 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.380048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1420/2852] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:34.384110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.394543 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d0e9-fc48-4175-a2e1-32d00da4a663 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.399267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.399965 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.400243 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.400515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] PATH_INFO: `/v3/projects/4afb960bf82946168e433d142499d670/users/ddd6a6c2805c4c90ab048cf8cbc7139d/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.416397 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afb960bf82946168e433d142499d670, user_id=ddd6a6c2805c4c90ab048cf8cbc7139d, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.419046 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.491144 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1433/2853] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:34 2022] PUT /identity/v3/projects/4afb960bf82946168e433d142499d670/users/ddd6a6c2805c4c90ab048cf8cbc7139d/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:34.495075 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.505380 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcadef-056c-456b-aa3b-af2cd28351bf admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.568731 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd4a30-b411-431c-bfb5-9aaa02cc6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.569345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd4a30-b411-431c-bfb5-9aaa02cc6185 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.569640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd4a30-b411-431c-bfb5-9aaa02cc6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.569911 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd4a30-b411-431c-bfb5-9aaa02cc6185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.570554 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd4a30-b411-431c-bfb5-9aaa02cc6185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.572210 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd4a30-b411-431c-bfb5-9aaa02cc6185 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.582483 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1421/2854] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:34.586653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.597988 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9ac1-9e41-4e04-b882-06aab1bfec5f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.602875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.603567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.603853 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.604133 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] PATH_INFO: `/v3/projects/4afb960bf82946168e433d142499d670/users/ddd6a6c2805c4c90ab048cf8cbc7139d/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.606039 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afb960bf82946168e433d142499d670, user_id=ddd6a6c2805c4c90ab048cf8cbc7139d, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.608724 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.619567 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1434/2855] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:34 2022] PUT /identity/v3/projects/4afb960bf82946168e433d142499d670/users/ddd6a6c2805c4c90ab048cf8cbc7139d/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:34.629679 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.629965 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.630242 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.659127 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] MFA Rules not processed for user `ddd6a6c2805c4c90ab048cf8cbc7139d`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:34.660406 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:34.732843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1422/2856] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:34.744653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:34.746370 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:34.811585 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3a376-5e1c-442c-ac76-4a093e322b01 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:34.816501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:34.817114 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:34.817398 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:34.817673 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:34.833388 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:34.835911 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:34.856012 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1435/2857] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:35.069389 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:35.079094 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4362cd-e04f-4789-8c3b-ce2e0d117d9e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:35.083801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487917d5-6bdc-4521-8a98-fe507b46a511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:35.084411 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487917d5-6bdc-4521-8a98-fe507b46a511 service cinder] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:35.084693 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487917d5-6bdc-4521-8a98-fe507b46a511 service cinder] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:35.084967 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487917d5-6bdc-4521-8a98-fe507b46a511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:35.089651 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:35.143515 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487917d5-6bdc-4521-8a98-fe507b46a511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:35.144926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487917d5-6bdc-4521-8a98-fe507b46a511 service cinder] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:35.153799 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1423/2858] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:43.561303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:43.578586 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:43.625003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318ac0a-1e73-49e6-9195-7bbb6acc4ee2 service cinder] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:43.630187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:43.630821 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:43.631106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:43.631400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] PATH_INFO: `/v3/users/8759b652633543f0bcb7a3e727a471f8` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:43.632564 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8759b652633543f0bcb7a3e727a471f8)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:43.634587 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:43.827680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8759b652633543f0bcb7a3e727a471f8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:43.905925 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8759b652633543f0bcb7a3e727a471f8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:43.919869 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8759b652633543f0bcb7a3e727a471f8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:43.927142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8759b652633543f0bcb7a3e727a471f8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:43.927941 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8759b652633543f0bcb7a3e727a471f8'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:43.934511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1436/2859] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:43 2022] DELETE /identity/v3/users/8759b652633543f0bcb7a3e727a471f8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:43.939018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:43.958509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:43.958509 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:43.959697 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:43.960897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:44.019117 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1424/2860] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:44.029286 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:44.030722 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:44.088676 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f5a3d-6a1f-444e-ba8d-97863d2c47df admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:44.092250 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:44.092846 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:44.093126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:44.093402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:44.102997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:44.104462 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:44.114090 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1437/2861] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:44.485498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:44.486914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:44.500238 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1ea04-01be-4192-ab54-4d58d2284092 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:44.506025 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:44.506662 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:44.506943 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:44.507351 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] PATH_INFO: `/v3/projects/be8cce16c7ed4465bd0d4c80ba5f855b` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:44.508503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8cce16c7ed4465bd0d4c80ba5f855b)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:44.510399 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:44.615321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8cce16c7ed4465bd0d4c80ba5f855b', 'request_id': 'req-0300999c-066a-46f1-b853-b45a75af16c0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:44.621342 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8cce16c7ed4465bd0d4c80ba5f855b', 'request_id': 'req-0300999c-066a-46f1-b853-b45a75af16c0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:44.626751 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8cce16c7ed4465bd0d4c80ba5f855b', 'request_id': 'req-0300999c-066a-46f1-b853-b45a75af16c0'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:44.699879 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] The token cache is being invalidate because project be8cce16c7ed4465bd0d4c80ba5f855b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:44.700171 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:44.700787 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:44.702249 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1425/2862] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:44 2022] DELETE /identity/v3/projects/be8cce16c7ed4465bd0d4c80ba5f855b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:44.706206 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:44.716124 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c501-2d82-4387-b778-e195c1ba6985 service neutron] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:44.750062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:44.772774 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:44.773525 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:44.773814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:44.774094 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] PATH_INFO: `/v3/users/ddd6a6c2805c4c90ab048cf8cbc7139d` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:44.775215 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd6a6c2805c4c90ab048cf8cbc7139d)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:44.777172 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:44.955208 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd6a6c2805c4c90ab048cf8cbc7139d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.009160 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd6a6c2805c4c90ab048cf8cbc7139d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.022150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd6a6c2805c4c90ab048cf8cbc7139d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.029069 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd6a6c2805c4c90ab048cf8cbc7139d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.029726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-2c3261b0-9847-414c-b180-096e70d3aaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd6a6c2805c4c90ab048cf8cbc7139d'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.036189 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1438/2863] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:44 2022] DELETE /identity/v3/users/ddd6a6c2805c4c90ab048cf8cbc7139d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:45.421398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:45.421398 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:45.434575 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300999c-066a-46f1-b853-b45a75af16c0 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:45.462905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:45.493605 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:45.494288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:45.494813 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:45.495159 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] PATH_INFO: `/v3/projects/4afb960bf82946168e433d142499d670` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:45.497049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afb960bf82946168e433d142499d670)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:45.499056 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:45.586349 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afb960bf82946168e433d142499d670', 'request_id': 'req-62219a5e-2055-4eb5-8838-5a0867d2d65b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.592540 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afb960bf82946168e433d142499d670', 'request_id': 'req-62219a5e-2055-4eb5-8838-5a0867d2d65b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.598254 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afb960bf82946168e433d142499d670', 'request_id': 'req-62219a5e-2055-4eb5-8838-5a0867d2d65b'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.648288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] The token cache is being invalidate because project 4afb960bf82946168e433d142499d670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81762) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:45.648583 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.649205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-62219a5e-2055-4eb5-8838-5a0867d2d65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:45.650761 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1426/2864] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:45 2022] DELETE /identity/v3/projects/4afb960bf82946168e433d142499d670 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:45.655557 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:45.655839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:45.656110 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:45.676055 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:45.677874 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:45.736117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1439/2865] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:45.744068 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:45.744362 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:45.744644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:45.764297 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:45.765500 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:45.773936 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1427/2866] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:45.777968 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:45.788560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ebe9-c6df-48a3-8a67-726788320821 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:45.793092 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:45.793687 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:45.793971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:45.794248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:45.794894 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81763) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:57:45.795202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:45.796840 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:45.808628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1440/2867] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:57:45.812866 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:45.822015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75db1-2076-4fd1-9453-76895987e08b None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:45.826816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:45.827427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:45.827721 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:45.828000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:45.828644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:45.830534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:45.909047 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1428/2868] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:45 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:45.912660 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:45.922749 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c896aa-1d69-4b46-924a-ba1bada7d8eb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:45.966414 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:45.981899 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:45.982503 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:45.982782 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:45.983059 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:45.983730 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:45.985641 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.061062 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1441/2869] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:45 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:57:46.065232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.075989 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bdd3-4b97-4238-b7a9-ddea2efd1037 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.080499 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.081090 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.081369 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.081641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.082299 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.084524 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.094136 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1429/2870] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:46.098023 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.108263 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160de20-79bd-4977-ab0f-c4b4240ed2a1 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.112971 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015053-32c4-46a3-a10b-9e97133c7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.113562 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015053-32c4-46a3-a10b-9e97133c7c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.113842 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015053-32c4-46a3-a10b-9e97133c7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.114116 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015053-32c4-46a3-a10b-9e97133c7c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.114758 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015053-32c4-46a3-a10b-9e97133c7c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.116511 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015053-32c4-46a3-a10b-9e97133c7c89 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.127065 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1442/2871] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:46.131698 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.141392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df902551-8f9c-465e-9930-4cd61253ccb8 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.146578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.147211 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.147534 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.147811 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] PATH_INFO: `/v3/projects/715a344b2d5e4dca8d239079b106ef0a/users/ca18688a294c4e02b1b37358849f7ada/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.162027 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715a344b2d5e4dca8d239079b106ef0a, user_id=ca18688a294c4e02b1b37358849f7ada, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.164685 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.231437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1430/2872] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:46 2022] PUT /identity/v3/projects/715a344b2d5e4dca8d239079b106ef0a/users/ca18688a294c4e02b1b37358849f7ada/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:57:46.297115 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.297400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.297678 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.326847 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] MFA Rules not processed for user `ca18688a294c4e02b1b37358849f7ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:46.327997 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:46.392362 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1443/2873] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:46.396914 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.464479 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:46.470061 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d6052-e019-41a5-b431-a3786fa1a109 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.475636 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.476247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.476533 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.476865 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.477495 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.479404 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.571804 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1431/2874] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:46 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:46.575838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.587772 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438043c3-d873-4b8f-99fd-101e6c35eea1 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.644640 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.645241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.645522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.646493 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.647623 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.651051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.730519 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1444/2875] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:46 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:46.734680 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.744986 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38a00-f184-4351-9c1e-53a29a25a6ce admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.749526 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.750118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.750400 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.750673 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.751345 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.752939 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.762843 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1432/2876] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:46.767095 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.779792 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd60ff-e070-495b-8ad5-412691b97ebb admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.784633 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.785315 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.785594 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.785864 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] PATH_INFO: `/v3/projects/cc598f17b9ca487dad90f855141fb2a7/users/07cd68e1491d4e1dbb1cffcae075c289/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.802428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc598f17b9ca487dad90f855141fb2a7, user_id=07cd68e1491d4e1dbb1cffcae075c289, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.805261 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.889570 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1445/2877] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:46 2022] PUT /identity/v3/projects/cc598f17b9ca487dad90f855141fb2a7/users/07cd68e1491d4e1dbb1cffcae075c289/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:57:46.893640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.904268 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f6cd1-4ee2-4605-89c9-b59072ceec8b admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.965041 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdac77-ba51-426c-aa0a-abadd6b2e945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.965648 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdac77-ba51-426c-aa0a-abadd6b2e945 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.965937 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdac77-ba51-426c-aa0a-abadd6b2e945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.966214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdac77-ba51-426c-aa0a-abadd6b2e945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:46.966855 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdac77-ba51-426c-aa0a-abadd6b2e945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:46.968470 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdac77-ba51-426c-aa0a-abadd6b2e945 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:46.978581 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1433/2878] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:46.982902 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:46.993305 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882e323-40b2-4c3d-8dda-39c3479a4a95 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:46.997832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:46.998474 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:46.998752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:46.999024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] PATH_INFO: `/v3/projects/cc598f17b9ca487dad90f855141fb2a7/users/07cd68e1491d4e1dbb1cffcae075c289/roles/7753c5d3c0704a95806502abd36b6b9a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:47.000976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc598f17b9ca487dad90f855141fb2a7, user_id=07cd68e1491d4e1dbb1cffcae075c289, role_id=7753c5d3c0704a95806502abd36b6b9a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:47.003615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:47.014520 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1446/2879] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:46 2022] PUT /identity/v3/projects/cc598f17b9ca487dad90f855141fb2a7/users/07cd68e1491d4e1dbb1cffcae075c289/roles/7753c5d3c0704a95806502abd36b6b9a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:47.025083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:47.025376 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:47.025656 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:47.053859 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] MFA Rules not processed for user `07cd68e1491d4e1dbb1cffcae075c289`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:47.055071 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:47.123644 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1434/2880] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:47.136166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:47.137860 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:47.144456 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:47.196670 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c92543-c10e-4c1e-bdcc-b0c638c32e93 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:47.200356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb76a07-6498-499a-bb31-41ca21428b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:47.200956 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76a07-6498-499a-bb31-41ca21428b3d service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:47.201240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76a07-6498-499a-bb31-41ca21428b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:47.201515 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb76a07-6498-499a-bb31-41ca21428b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:47.211047 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb76a07-6498-499a-bb31-41ca21428b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:47.212976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb76a07-6498-499a-bb31-41ca21428b3d service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:47.223423 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1447/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 14:57:47.378247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:47.432488 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:47.444655 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13fddf-5b02-44db-b1e4-f645d151089a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:47.449093 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:47.449720 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:47.450000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:47.450272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] PATH_INFO: `/v3/users/ca18688a294c4e02b1b37358849f7ada` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:47.451402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca18688a294c4e02b1b37358849f7ada)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:47.453288 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:47.650281 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca18688a294c4e02b1b37358849f7ada'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:47.650985 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca18688a294c4e02b1b37358849f7ada'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:47.657886 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca18688a294c4e02b1b37358849f7ada'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:47.675517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca18688a294c4e02b1b37358849f7ada'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:47.675517 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca18688a294c4e02b1b37358849f7ada'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:47.757462 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1435/2882] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:47 2022] DELETE /identity/v3/users/ca18688a294c4e02b1b37358849f7ada => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:47.762011 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:47.762303 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:47.762627 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:47.781378 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:47.784546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:47.843551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1448/2883] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:47.854391 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:47.855820 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:47.912785 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7b14-ad7b-42b7-8b30-a73c95c82869 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:47.916521 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:47.917139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:47.917422 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:47.917696 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:47.928154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:47.929525 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:47.939079 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1436/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:48.320296 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:48.321751 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:48.340413 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744c5d-4292-4076-8d28-8cbbfece1fc0 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:48.345524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:48.346068 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:48.346348 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:48.346621 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] PATH_INFO: `/v3/projects/715a344b2d5e4dca8d239079b106ef0a` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:48.347857 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715a344b2d5e4dca8d239079b106ef0a)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:48.350558 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:48.443905 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715a344b2d5e4dca8d239079b106ef0a', 'request_id': 'req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.483844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715a344b2d5e4dca8d239079b106ef0a', 'request_id': 'req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.490169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715a344b2d5e4dca8d239079b106ef0a', 'request_id': 'req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.505954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] The token cache is being invalidate because project 715a344b2d5e4dca8d239079b106ef0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:48.506248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.506915 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.508453 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1449/2885] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:48 2022] DELETE /identity/v3/projects/715a344b2d5e4dca8d239079b106ef0a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:48.512487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:48.522442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58187642-b208-4172-a7b8-94a42cdd7607 service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:48.578853 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:48.579512 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:48.579801 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:48.580083 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] PATH_INFO: `/v3/users/07cd68e1491d4e1dbb1cffcae075c289` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:48.581193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07cd68e1491d4e1dbb1cffcae075c289)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:48.583180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:48.596725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:48.737875 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cd68e1491d4e1dbb1cffcae075c289'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.738498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cd68e1491d4e1dbb1cffcae075c289'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.745667 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cd68e1491d4e1dbb1cffcae075c289'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.758042 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cd68e1491d4e1dbb1cffcae075c289'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.758684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-668ed127-eddf-4765-b60b-172272947369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cd68e1491d4e1dbb1cffcae075c289'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:48.802912 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1437/2886] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:48 2022] DELETE /identity/v3/users/07cd68e1491d4e1dbb1cffcae075c289 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:49.188169 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:49.189671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:49.203247 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d605dd-1fd8-4c22-8692-0b74a9d3df55 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:49.233605 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:49.262439 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:49.263066 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.263350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.263662 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] PATH_INFO: `/v3/projects/cc598f17b9ca487dad90f855141fb2a7` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.264780 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc598f17b9ca487dad90f855141fb2a7)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:49.266820 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:49.370076 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc598f17b9ca487dad90f855141fb2a7', 'request_id': 'req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:49.465963 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc598f17b9ca487dad90f855141fb2a7', 'request_id': 'req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:49.471920 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc598f17b9ca487dad90f855141fb2a7', 'request_id': 'req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:49.483711 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] The token cache is being invalidate because project cc598f17b9ca487dad90f855141fb2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:49.484003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:49.484642 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-349a68ea-94ad-438d-b2a9-ce7f0dcb7331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:49.486151 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1450/2887] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:49 2022] DELETE /identity/v3/projects/cc598f17b9ca487dad90f855141fb2a7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:49.491905 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.492199 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.492482 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.514929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:49.517915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:49.576321 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1438/2888] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:49.584377 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.584671 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.584954 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.604962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:49.606207 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:49.614002 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1451/2889] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:49.618848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:49.628300 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67945f4a-2cf1-4926-8fb8-1af7b359a745 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:49.633307 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:49.633901 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.634183 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.634464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.635116 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:57:49.635465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:49.637088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:49.648795 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1439/2890] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:57:49.653158 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:49.662644 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f31f8d-621b-4d61-865e-e151be3a898d None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:49.667292 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:49.667914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.668197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.668470 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.669106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:49.670993 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:49.765357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1452/2891] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:49 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:57:49.769423 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:49.780166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971cfa-2a9d-40d0-9913-04798f15d32a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:49.851166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:49.852097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.852527 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.852947 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.853935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:49.857049 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:49.964782 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1440/2892] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:49 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:57:49.968757 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:49.979109 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aad9b-b06c-4a2c-b9b1-9e739437522f admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:49.983712 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:49.984301 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:49.984576 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:49.992202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:49.992202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:49.992202 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:49.997003 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1453/2893] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:50.000838 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:50.011712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb52185-51f8-4e05-a215-c6f7fda66aeb admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:50.016464 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0b6b-6a17-4785-bc7f-77ad60942df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:50.017029 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0b6b-6a17-4785-bc7f-77ad60942df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:50.017312 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0b6b-6a17-4785-bc7f-77ad60942df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:50.017588 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0b6b-6a17-4785-bc7f-77ad60942df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:50.018232 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0b6b-6a17-4785-bc7f-77ad60942df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:50.019856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0b6b-6a17-4785-bc7f-77ad60942df6 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:50.022530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:50.031209 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1441/2894] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:50.042823 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:50.053045 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75edbbb-9f1c-40e8-bb44-f05862bc4977 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:50.057817 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:50.058467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:50.058962 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:50.059249 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] PATH_INFO: `/v3/projects/8c79d2ee0000425aa4aa1f93e2eb32b0/users/a368cb2225f143cf8d9832362bfd8e72/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:50.074546 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c79d2ee0000425aa4aa1f93e2eb32b0, user_id=a368cb2225f143cf8d9832362bfd8e72, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:50.077238 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:50.158022 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1454/2895] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:50 2022] PUT /identity/v3/projects/8c79d2ee0000425aa4aa1f93e2eb32b0/users/a368cb2225f143cf8d9832362bfd8e72/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:50.170597 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:50.171064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:50.171711 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:50.201516 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] MFA Rules not processed for user `a368cb2225f143cf8d9832362bfd8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:50.202736 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:50.268213 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1442/2896] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:50.279258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:50.281030 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:50.338628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4653c-7e62-43d8-b29d-60e3ab7dd59e admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:50.342448 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88b4e4-80d0-4a83-802a-ea1c50b30d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:50.343063 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b4e4-80d0-4a83-802a-ea1c50b30d60 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:50.343350 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b4e4-80d0-4a83-802a-ea1c50b30d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:50.343655 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b4e4-80d0-4a83-802a-ea1c50b30d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:50.353741 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88b4e4-80d0-4a83-802a-ea1c50b30d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:50.355170 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88b4e4-80d0-4a83-802a-ea1c50b30d60 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:50.359851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:50.364382 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1455/2897] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:54.203193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:54.265780 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c721fd-82c6-4421-b12d-b0fd164692ef None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:54.270317 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:54.271665 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:54.271955 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:54.272235 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] PATH_INFO: `/v3/users/a368cb2225f143cf8d9832362bfd8e72` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:54.273359 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a368cb2225f143cf8d9832362bfd8e72)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:54.275592 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:54.457722 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a368cb2225f143cf8d9832362bfd8e72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:54.460657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a368cb2225f143cf8d9832362bfd8e72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:54.469915 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a368cb2225f143cf8d9832362bfd8e72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:54.482366 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a368cb2225f143cf8d9832362bfd8e72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:54.483062 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a368cb2225f143cf8d9832362bfd8e72'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:54.543954 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1443/2898] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:57:54 2022] DELETE /identity/v3/users/a368cb2225f143cf8d9832362bfd8e72 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 14:57:54.548616 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:54.551530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:54.551530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:54.569316 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:54.570521 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:54.628593 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1456/2899] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:54.638861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:54.640272 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:54.650968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:54.698328 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e2de-05d3-47d5-a3e7-f91d9eed798d admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:54.701929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a973678-799e-4689-a813-ce16c2307b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:54.702532 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a973678-799e-4689-a813-ce16c2307b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:54.702806 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a973678-799e-4689-a813-ce16c2307b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:54.703077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a973678-799e-4689-a813-ce16c2307b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:54.712180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a973678-799e-4689-a813-ce16c2307b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:54.713946 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a973678-799e-4689-a813-ce16c2307b72 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:54.723091 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1444/2900] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:57:55.074634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.076106 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:55.088790 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87272fa3-2e2c-4bff-80e4-bc7cc1a1129a None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.093801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.094438 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.094714 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.094976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] PATH_INFO: `/v3/projects/8c79d2ee0000425aa4aa1f93e2eb32b0` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.096125 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c79d2ee0000425aa4aa1f93e2eb32b0)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.099524 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.197752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c79d2ee0000425aa4aa1f93e2eb32b0', 'request_id': 'req-d802e063-7aff-4e4e-93ff-31c9361e4c6f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:55.249588 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c79d2ee0000425aa4aa1f93e2eb32b0', 'request_id': 'req-d802e063-7aff-4e4e-93ff-31c9361e4c6f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:55.255799 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c79d2ee0000425aa4aa1f93e2eb32b0', 'request_id': 'req-d802e063-7aff-4e4e-93ff-31c9361e4c6f'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:55.267070 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] The token cache is being invalidate because project 8c79d2ee0000425aa4aa1f93e2eb32b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:57:55.267356 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:55.268014 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-d802e063-7aff-4e4e-93ff-31c9361e4c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:57:55.269581 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1457/2901] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:57:55 2022] DELETE /identity/v3/projects/8c79d2ee0000425aa4aa1f93e2eb32b0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:55.274436 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.274926 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.275026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.295031 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:55.296270 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:55.362637 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1445/2902] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 14:57:55.371331 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.371659 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.371934 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.392702 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:55.393916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:55.402637 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1458/2903] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:55.406968 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.417645 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c7d13-4560-45c7-a65e-18cc5dff8778 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.422578 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.423336 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.423567 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.423750 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.424432 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:57:55.424818 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.426402 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.438505 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1446/2904] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:57:55.442931 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.452357 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb069-2254-4d23-a006-1293a2a632da None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.456937 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.457529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.457804 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.458596 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.459226 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.461135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.542492 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1459/2905] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:57:55 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:57:55.546815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.557884 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c7995-50ae-4902-be71-e9100139e9ed admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.613343 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.613870 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.614153 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.615064 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.616016 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.617952 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.689088 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1447/2906] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:57:55 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 14:57:55.693884 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.704579 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d914a-7660-49ae-8706-51ccf97de5c4 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.709360 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.709957 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.710240 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.710514 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.711150 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.712785 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.722532 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1460/2907] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:55.726758 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.736632 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651106-aa9c-464b-92f1-4415789bf5d7 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.742098 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b56a7-ee17-4a09-91e9-5e3802f48744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.742702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b56a7-ee17-4a09-91e9-5e3802f48744 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.743017 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b56a7-ee17-4a09-91e9-5e3802f48744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.743298 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b56a7-ee17-4a09-91e9-5e3802f48744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.744003 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b56a7-ee17-4a09-91e9-5e3802f48744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.747085 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b56a7-ee17-4a09-91e9-5e3802f48744 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.761669 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1448/2908] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:57:55.765809 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.776099 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e02b-c251-4a66-a98d-8a2c817b5a1d admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:55.780615 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:55.781252 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.781530 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.781801 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] PATH_INFO: `/v3/projects/f6cfde72deb0480c8643b704ca1b3791/users/ddbd202f0740470ba09328946d648bd4/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.795908 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cfde72deb0480c8643b704ca1b3791, user_id=ddbd202f0740470ba09328946d648bd4, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:55.798541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:55.872267 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1461/2909] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:57:55 2022] PUT /identity/v3/projects/f6cfde72deb0480c8643b704ca1b3791/users/ddbd202f0740470ba09328946d648bd4/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:57:55.883930 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b946-e900-4770-8639-413806a3ca7d None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:55.884220 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b946-e900-4770-8639-413806a3ca7d None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:55.884498 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263b946-e900-4770-8639-413806a3ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:55.912208 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-0263b946-e900-4770-8639-413806a3ca7d None None] MFA Rules not processed for user `ddbd202f0740470ba09328946d648bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:57:55.913417 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-0263b946-e900-4770-8639-413806a3ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:55.917333 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:55.979647 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1449/2910] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:57:55.992487 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:57:55.994187 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:57:56.016235 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:57:56.052753 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a787d9-a5a9-4d22-ab56-9c97e7883f72 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:57:56.056622 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9b404-6c55-4e22-88dc-75200795e6d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c333a75ebd74779acf201947470a92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:57:56.057220 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9b404-6c55-4e22-88dc-75200795e6d4 service glance] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:57:56.057504 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9b404-6c55-4e22-88dc-75200795e6d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:57:56.057783 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9b404-6c55-4e22-88dc-75200795e6d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:57:56.066372 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9b404-6c55-4e22-88dc-75200795e6d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:57:56.068551 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9b404-6c55-4e22-88dc-75200795e6d4 service glance] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:57:56.077483 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1462/2911] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:58:05.976791 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=25 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:06.083258 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=17 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:19.095544 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b946-e900-4770-8639-413806a3ca7d None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:19.159702 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263b946-e900-4770-8639-413806a3ca7d None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:19.164762 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:19.165392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:19.165683 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:19.165959 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] PATH_INFO: `/v3/users/ddbd202f0740470ba09328946d648bd4` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:19.167076 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddbd202f0740470ba09328946d648bd4)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:19.169018 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:19.348205 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddbd202f0740470ba09328946d648bd4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:19.348863 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddbd202f0740470ba09328946d648bd4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:19.356748 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddbd202f0740470ba09328946d648bd4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:19.369337 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddbd202f0740470ba09328946d648bd4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:19.370037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddbd202f0740470ba09328946d648bd4'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:19.437246 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1450/2912] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:58:19 2022] DELETE /identity/v3/users/ddbd202f0740470ba09328946d648bd4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:58:19.447765 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:19.448236 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:19.448352 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:19.468669 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:19.469851 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:19.526541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1463/2913] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:19.536118 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:19.537600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:19.596033 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdb796-d999-49dd-95ab-9b74896a7658 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:19.599701 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19945aed-92eb-406b-bf39-3680a3dc88bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:19.600247 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19945aed-92eb-406b-bf39-3680a3dc88bd service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:19.601198 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19945aed-92eb-406b-bf39-3680a3dc88bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:19.601710 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19945aed-92eb-406b-bf39-3680a3dc88bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:19.610561 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19945aed-92eb-406b-bf39-3680a3dc88bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:19.612015 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19945aed-92eb-406b-bf39-3680a3dc88bd service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:19.621709 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1451/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:58:19.988323 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:19.989914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:20.002636 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1924e-abb9-4f20-846f-80b3d71c0f45 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.008214 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.008848 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.009126 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.009428 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] PATH_INFO: `/v3/projects/f6cfde72deb0480c8643b704ca1b3791` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.010541 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cfde72deb0480c8643b704ca1b3791)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.012478 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.113328 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cfde72deb0480c8643b704ca1b3791', 'request_id': 'req-ecd227b8-cf3c-4b12-914f-e045ed867252'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:20.169516 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cfde72deb0480c8643b704ca1b3791', 'request_id': 'req-ecd227b8-cf3c-4b12-914f-e045ed867252'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:20.176233 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cfde72deb0480c8643b704ca1b3791', 'request_id': 'req-ecd227b8-cf3c-4b12-914f-e045ed867252'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:20.188467 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] The token cache is being invalidate because project f6cfde72deb0480c8643b704ca1b3791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:58:20.188764 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:20.189402 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-ecd227b8-cf3c-4b12-914f-e045ed867252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:20.190883 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1464/2915] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:58:19 2022] DELETE /identity/v3/projects/f6cfde72deb0480c8643b704ca1b3791 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:58:20.196579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.197104 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.197224 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.216712 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:20.217919 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:20.234987 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:20.279447 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1452/2916] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:20.287227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.287668 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.287865 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.308084 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:20.309295 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:20.317182 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1465/2917] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:20.321988 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.331568 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f016-de6b-4b9d-981e-d9bda6d0978a None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.336684 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.337284 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.337569 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.337848 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.338530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:58:20.338837 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.340507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.352816 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1453/2918] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:58:20.356976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.366199 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf21a-84aa-401d-a21b-e554a1facdf8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.370990 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.371629 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.371914 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.372192 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.372818 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.374803 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.497257 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1466/2919] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:58:20 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:58:20.501448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.512248 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55adc0-ffe3-44b5-a364-b6e56d4a7b71 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.567430 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.568039 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.568355 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.568638 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.569792 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.572000 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.666528 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1454/2920] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:58:20 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:58:20.670653 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.681400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac3d86-c14c-4a2c-95aa-fbdf597903f7 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.686166 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.688870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.688870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.688870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.688870 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.689743 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.700725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1467/2921] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:58:20.704906 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.715434 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f95ea0-d942-4a0d-b8c0-16827cbed444 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.720050 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573373a-88ca-4cf3-954f-14e39b26ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.720641 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573373a-88ca-4cf3-954f-14e39b26ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.720929 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573373a-88ca-4cf3-954f-14e39b26ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.721206 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573373a-88ca-4cf3-954f-14e39b26ab40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.721851 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573373a-88ca-4cf3-954f-14e39b26ab40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.723461 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573373a-88ca-4cf3-954f-14e39b26ab40 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.737788 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1455/2922] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:58:20.743121 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.753471 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303dce86-4e6e-4fef-9a9a-96633d32d5f5 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:20.759135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:20.759832 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.760117 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.760400 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] PATH_INFO: `/v3/projects/797f7a2a72fc45acbe428e28ca54cd3e/users/6f03eeba474d4cf88a41e96240dec9fa/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.776477 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797f7a2a72fc45acbe428e28ca54cd3e, user_id=6f03eeba474d4cf88a41e96240dec9fa, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:20.779135 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:20.843634 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1468/2923] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:58:20 2022] PUT /identity/v3/projects/797f7a2a72fc45acbe428e28ca54cd3e/users/6f03eeba474d4cf88a41e96240dec9fa/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:58:20.854603 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:20.854883 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:20.855161 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:20.883354 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] MFA Rules not processed for user `6f03eeba474d4cf88a41e96240dec9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:20.884607 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:20.950413 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1456/2924] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:20.961488 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:20.963183 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:20.985406 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:21.021373 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb737d-ee11-4ca0-a6ab-7d4dc1647393 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:21.025631 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d8cdb-7cda-4130-bb6a-ab5ea1a025b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:21.026726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8cdb-7cda-4130-bb6a-ab5ea1a025b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:21.026726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8cdb-7cda-4130-bb6a-ab5ea1a025b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:21.027035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d8cdb-7cda-4130-bb6a-ab5ea1a025b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:21.035766 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d8cdb-7cda-4130-bb6a-ab5ea1a025b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:21.037325 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d8cdb-7cda-4130-bb6a-ab5ea1a025b4 service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:21.046628 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1469/2925] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:58:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:58:30.947507 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:31.289960 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=17 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:53.213715 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:53.274630 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2682e3c-d10f-4ccc-8132-fbe706d4b9b0 None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:53.279139 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:53.280657 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:53.281077 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:53.281493 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] PATH_INFO: `/v3/users/6f03eeba474d4cf88a41e96240dec9fa` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:53.282891 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f03eeba474d4cf88a41e96240dec9fa)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:53.284832 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:53.480726 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f03eeba474d4cf88a41e96240dec9fa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:53.481401 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f03eeba474d4cf88a41e96240dec9fa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:53.488335 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f03eeba474d4cf88a41e96240dec9fa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:53.500265 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f03eeba474d4cf88a41e96240dec9fa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:53.500935 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f03eeba474d4cf88a41e96240dec9fa'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:53.562902 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1457/2926] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:58:53 2022] DELETE /identity/v3/users/6f03eeba474d4cf88a41e96240dec9fa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:58:53.567497 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:53.567980 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:53.568085 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:53.587528 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:53.588734 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:53.646168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1470/2927] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:53.656601 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:53.658026 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:53.716014 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccd2ce-da37-4e46-b222-8f8447f9d20a admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:53.720111 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a037-856f-4a4c-9586-2d13be8abfc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:53.720724 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a037-856f-4a4c-9586-2d13be8abfc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:53.721007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a037-856f-4a4c-9586-2d13be8abfc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:53.721287 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a037-856f-4a4c-9586-2d13be8abfc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:53.730918 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80a037-856f-4a4c-9586-2d13be8abfc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:53.733392 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80a037-856f-4a4c-9586-2d13be8abfc4 service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:53.743155 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1458/2928] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:58:54.130838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.132419 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:54.147879 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc4b0-7cde-4b3d-bba8-2161732a44a8 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.153839 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.154345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.154626 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.154927 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] PATH_INFO: `/v3/projects/797f7a2a72fc45acbe428e28ca54cd3e` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.156168 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=797f7a2a72fc45acbe428e28ca54cd3e)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.158058 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.289153 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797f7a2a72fc45acbe428e28ca54cd3e', 'request_id': 'req-a91c5617-c2f1-4a47-b266-ae831982d1a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:54.357600 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797f7a2a72fc45acbe428e28ca54cd3e', 'request_id': 'req-a91c5617-c2f1-4a47-b266-ae831982d1a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:54.364176 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797f7a2a72fc45acbe428e28ca54cd3e', 'request_id': 'req-a91c5617-c2f1-4a47-b266-ae831982d1a1'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:54.375966 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] The token cache is being invalidate because project 797f7a2a72fc45acbe428e28ca54cd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:58:54.376253 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:54.376875 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-a91c5617-c2f1-4a47-b266-ae831982d1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:58:54.378336 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1471/2929] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:58:54 2022] DELETE /identity/v3/projects/797f7a2a72fc45acbe428e28ca54cd3e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:58:54.383427 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a26cc-a36e-421a-850b-828810f8072e None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.383897 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a26cc-a36e-421a-850b-828810f8072e None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.383999 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a26cc-a36e-421a-850b-828810f8072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.403326 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-410a26cc-a36e-421a-850b-828810f8072e None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:54.404565 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-410a26cc-a36e-421a-850b-828810f8072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:54.422069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:54.464105 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1459/2930] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:54.472592 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.472885 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.473167 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.493828 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:54.495035 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:54.503024 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1472/2931] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:54.507193 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a26cc-a36e-421a-850b-828810f8072e None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.516861 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a26cc-a36e-421a-850b-828810f8072e None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.521410 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.522007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.522320 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.522600 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.523251 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81762) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 14:58:54.523593 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.525180 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.537201 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1460/2932] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Sep 7 14:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 14:58:54.541560 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.551322 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e6b4-6623-41b0-925d-be6b02b49c84 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.556031 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.556646 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.556926 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.557197 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.557814 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.559725 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.627101 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1473/2933] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Sep 7 14:58:54 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:58:54.631261 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.641487 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2198f5-1d46-4e7f-a837-1afa59be9f18 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.705157 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.705765 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.706048 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.706357 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] PATH_INFO: `/v3/users` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.706991 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.708982 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.798810 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1461/2934] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Sep 7 14:58:54 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 14:58:54.802680 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.813345 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626cc20-e42c-4e69-a365-3dadab472276 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.817838 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.818429 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.818704 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.818976 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.819663 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.821246 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.831826 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1474/2935] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:58:54.836123 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.846807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346478d-2bf3-4d19-90b4-da2d0ff92e28 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.851448 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7718d-05fe-4e15-9cf5-7b6f3f756f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.852293 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7718d-05fe-4e15-9cf5-7b6f3f756f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.852579 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7718d-05fe-4e15-9cf5-7b6f3f756f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.852856 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7718d-05fe-4e15-9cf5-7b6f3f756f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.853609 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7718d-05fe-4e15-9cf5-7b6f3f756f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.855195 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7718d-05fe-4e15-9cf5-7b6f3f756f7f admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.865069 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1462/2936] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Sep 7 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 14:58:54.869248 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:54.879535 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedee411-a6e6-4e47-9e47-87d7e7801b08 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:54.884100 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:54.884747 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:54.885033 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:54.885313 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] PATH_INFO: `/v3/projects/b63a9c374762423e96681e72d6a91b69/users/09b5506a7e804047843583ac2e9d6f79/roles/8d82548844954170a8a5017f7a605f61` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:54.901378 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63a9c374762423e96681e72d6a91b69, user_id=09b5506a7e804047843583ac2e9d6f79, role_id=8d82548844954170a8a5017f7a605f61)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:54.904087 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:54.998330 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1475/2937] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Sep 7 14:58:54 2022] PUT /identity/v3/projects/b63a9c374762423e96681e72d6a91b69/users/09b5506a7e804047843583ac2e9d6f79/roles/8d82548844954170a8a5017f7a605f61 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:58:55.008640 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] REQUEST_METHOD: `POST` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:55.013073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:55.013073 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:55.039414 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.auth.core [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] MFA Rules not processed for user `09b5506a7e804047843583ac2e9d6f79`. Rule list: `[]` (Enabled: `True`). {{(pid=81762) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:58:55.040613 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:55.103577 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1463/2938] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:58:55.114224 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:58:55.115900 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:58:55.137146 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:58:55.172051 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a8347-d8cc-4115-8e57-8f6ecc328fc8 admin admin] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:58:55.175726 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b2ae-a93c-4ef8-ae89-5a6cf9cdd5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f7c352378a4bc08f1d1acddae20cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:58:55.181893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b2ae-a93c-4ef8-ae89-5a6cf9cdd5ea service cinder] REQUEST_METHOD: `GET` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:58:55.181893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b2ae-a93c-4ef8-ae89-5a6cf9cdd5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:58:55.181893 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b2ae-a93c-4ef8-ae89-5a6cf9cdd5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:58:55.184844 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b2ae-a93c-4ef8-ae89-5a6cf9cdd5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:58:55.186256 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b2ae-a93c-4ef8-ae89-5a6cf9cdd5ea service cinder] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:58:55.195297 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1476/2939] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:58:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:59:05.100485 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:59:05.243522 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=17 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:59:07.004530 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:59:07.067154 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024b46b-786b-4356-936b-62cae6d6331f None None] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:59:07.071807 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:59:07.072437 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:59:07.072725 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:59:07.073007 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] PATH_INFO: `/v3/users/09b5506a7e804047843583ac2e9d6f79` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:59:07.074128 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b5506a7e804047843583ac2e9d6f79)` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:59:07.076081 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:59:07.212315 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b5506a7e804047843583ac2e9d6f79'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:07.212975 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b5506a7e804047843583ac2e9d6f79'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:07.220503 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b5506a7e804047843583ac2e9d6f79'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:07.233396 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b5506a7e804047843583ac2e9d6f79'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:07.233770 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.notifications [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b5506a7e804047843583ac2e9d6f79'} {{(pid=81762) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:07.306766 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1464/2940] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Sep 7 14:59:07 2022] DELETE /identity/v3/users/09b5506a7e804047843583ac2e9d6f79 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:59:07.311752 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] REQUEST_METHOD: `POST` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:59:07.312227 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:59:07.312342 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:59:07.331972 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.auth.core [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] MFA Rules not processed for user `c13c46ea6a164631878622a88f432086`. Rule list: `[]` (Enabled: `True`). {{(pid=81763) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 14:59:07.333241 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:59:07.393306 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1477/2941] 10.222.0.17 () {58 vars in 958 bytes} [Wed Sep 7 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 14:59:07.406037 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:59:07.408097 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:59:07.465465 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f133-675a-4a14-87e3-960ef683d981 admin admin] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:59:07.469113 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3493b21604b404391be7b8909461d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:59:07.469727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:59:07.470553 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:59:07.470831 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:59:07.480476 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:59:07.481899 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:59:07.492109 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1465/2942] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 14:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 14:59:07.879501 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] Authenticating user token {{(pid=81763) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 14:59:07.880973 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.fernet_utils [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81763) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 14:59:07.895498 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88242-a6c3-4e92-a0ff-fcbf19be27c4 None None] Validating token access rules against request {{(pid=81763) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 14:59:07.900654 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13c46ea6a164631878622a88f432086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c72aa1856259455ba01399dfc01a267f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81763) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 14:59:07.901468 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 14:59:07.901777 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 14:59:07.902018 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] PATH_INFO: `/v3/projects/b63a9c374762423e96681e72d6a91b69` {{(pid=81763) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 14:59:07.903138 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63a9c374762423e96681e72d6a91b69)` {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 14:59:07.905072 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] RBAC: Authorization granted {{(pid=81763) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 14:59:08.119775 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63a9c374762423e96681e72d6a91b69', 'request_id': 'req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:08.156916 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63a9c374762423e96681e72d6a91b69', 'request_id': 'req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:08.163142 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63a9c374762423e96681e72d6a91b69', 'request_id': 'req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c'} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:08.175032 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] The token cache is being invalidate because project b63a9c374762423e96681e72d6a91b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81763) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 14:59:08.175320 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:08.175992 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG keystone.notifications [None req-7b1dff96-bbdc-461c-9aad-48ad7aa9b48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81763) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 14:59:08.177529 dv-cinder-801354-8-smb devstack@keystone.service[81763]: [pid: 81763|app: 0|req: 1478/2943] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Sep 7 14:59:07 2022] DELETE /identity/v3/projects/b63a9c374762423e96681e72d6a91b69 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 14:59:17.487857 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:59:18.171457 dv-cinder-801354-8-smb devstack@keystone.service[81763]: DEBUG dbcounter [-] [81763] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:00:17.534442 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] Authenticating user token {{(pid=81762) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:00:17.536664 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:00:17.604951 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8950db-bc8c-4acb-b067-098475ed1e5f service neutron] Validating token access rules against request {{(pid=81762) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:00:17.662214 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43b30d76472244e1a92d4787d0a2be66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b06ff986bb4ef685aa5ce1ec40f4a5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81762) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:00:17.662815 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] REQUEST_METHOD: `GET` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:00:17.663099 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] SCRIPT_NAME: `/identity` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:00:17.663390 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81762) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:00:17.665310 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.fernet_utils [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81762) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:00:17.677166 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:00:17.678727 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be3af3-1a79-4208-893f-a400d39f29bd service placement] RBAC: Authorization granted {{(pid=81762) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:00:17.688582 dv-cinder-801354-8-smb devstack@keystone.service[81762]: [pid: 81762|app: 0|req: 1466/2944] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Sep 7 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:00:27.684375 dv-cinder-801354-8-smb devstack@keystone.service[81762]: DEBUG dbcounter [-] [81762] Writing DB stats keystone:SELECT=58 {{(pid=81762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}